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NOTES ON HOMOTOPY OF THOM SPECTRA. 


By Arunas Livnevicrus.* 


Let & be one of the classical Lie groups: O, U, SO, SU, Sp. Let MG 
be the corresponding Thom spectrum [8]. We wish to compute the homotopy 
of MG modulo elements of finite order prime to 2. As in [8], the main 
tool is the Adams spectral sequence [1] for the prime two. 

Most of the results of Chapter II were known to Milnor [8] and Novikov 
[11]. The only claim to originality is Chapter II. 

The first chapter is devoted to homological algebra: a “change of rings” 
theorem is presented, which computes the cohomology of sundry subalgebras 
of the Steenrod algebra. The second chapter applies these results to compute 
the integral and 2-primary parts of the homotopy of MG. 

It is shown that all differentials vanish in the Adams spectral sequence 
for MO, MU, MSO. It is also shown that not all differentials are zero in the 
spectral sequence for MSU and MSp. 


Chapter I. 


1.1. A change of rings theorem. Let R, 8 be rings with unit, k: 
R>S$ a ring homomorphism. If N is a left S-module, we may consider it ` 
as a left R-module through the homomorphism h. Take (C,d,,€,) to be an 
8-projective resolution of N: 


€ d do 
CED: are 0,6 nee un, 


Let (Xa do eg) be an R-projective resolution of C, in (1.1.1): 


& ` do do 
(1.1.2) 0 < Og w X99 ———- Xie: + << Xyr-e-—— . 
There exist maps [3] dı: Xen —> X, such that 
(1.1.3) «d, = oEg+13 dido + doh, = 0. 


Received May 21, 1982. 
Revised September 16, 1963. 
* The author holds a National Science Foundation post-doctoral fellowship. 
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2 ARUNAS LIULEVIOIUS. 
Let =È Xo Y, = Pe Kar Define e: Y>N by e= elZ). 


 Tarormm I.1. There is a diferential d in Y such that (X, d, ) 3 an 
R-projective resolution of N. 


Proof. The differential d in Y need only have the following property: 
it d= Sid, where dy: X, > Xas then it is only necessary that dy and dy 
k=0 
are as in (1.1.3). The fact that d is a differential is expressed by 


i k 
(1.1.4) > drad = 0, for all k. 
i 


The mapping dr: Zar Xex,rıxı i8 constructed by induction on r. We 
suppose d; for i < k have been defined on Xar and dy is defined for Xgr+ 


k-1 i 
(note that dy =0 if r —i <0). Let h=—2 dyad Then it is immediate 
from (1.1.4) that dof = 0, thus, since Xg-x is TE, there is an E-map dy 
such that dad, == fr, which is the relation (1.1.4) for dy at Zr. 
To show that Y is acyclic under d, we filter Y by Ra = È Xy In the 


spectral sequence for this filtration Ep? == Xp, and the differential corresponds 
to do Thus Æ, = 0p, and the differential dt corresponds to d, in virtue of 
(1.1.3). Thus #,?=-H,—=0 if p40, and E,—N in total degree 0. 

Remark. Theorem I.1 is stated by Wall in [14] for the special case 
Re=Z(@), S—Z(H), where G, H are finite groups and H is a quotient 
of G. The proof above is an immediate generalization. 

We will be interested in Theorem I. 1 applied to Hopf algebras. Let E 
be a graded, connected, associative Hopf algebra [9] over a field X; let F 
be a Hopf subalgebra of E. 


THrorem 1.2 (Milnor-Moore). E is free as a left (or right) F-module. 
COROLLARY 1.3. E®r is an exact functor. 


This is Theorem 2.5 of [9]. The corollary is immediate. 

We say that F is normal [9] in E (and write F 4E) if EP=PE, 
~ where F denotes the augmentation ideal of F. If F<IE, then B= E/EF 
is again a connected Hopf algebra over K (B is denoted by E/F). Let 
aw: E>B be the projection. 


Proposition I.4. If (D,d,e) is an F-free resolution of K, then 
(E®rD, 18rd, 18pe) is an E-free resolution of B. 
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Proof. As a left E-module, B=E®&rK. The complex E®rD is E- 
free and is still acyclic, according to Corollary 1.3. 


CoRoLLarY 1.5. If E, B, F are as above 
(1.1.5) Ezts*' (B, K) = Ext” (K, K). 


Proof. Let D be as in Proposition I.4. Then Homg(l @rD, K) 
œ Homp(D, K) as cochain complexes, hence (1.1.5). 

Let us apply Theorem I.1 to R= E, 8 =B, F as above. Suppose that 
N is a graded B-module. We let 0, =— B 8g CG; as left B-modules (projective 
== free, since B is graded, connected [4]). According to Proposition I.4 
we can take for X, the complex F 8r Qr D, where D = K r D. We let 
Xı; =E 8r 8r D. To construct the differential d, it is sufficient to give 
E-maps d, satisfying (1.1.3) and (1.1.4). 

We need just one more remark before we go on to examine some sub- 
algebras of the Steenrod algebra. Let E be a connected Hopf algebra over 
the field K, F a Hopf subalgebra. Let J be a left ideal in F, I = EJ the 
E-extension of J to a left ideal in E. 


Lemma 1.6. H@pP/J==H/I as a left E-module. 
Proof. Consider the exact sequence of F-modules 


0>J>F>F/J>0 
and apply E &r. 


COROLLARY 1.7. 
Ext’! (E/I, K) = Extp"t(F/J,K). 


Proof. Take an F-free resolution of F/J and apply E®r, then use 
Lemma I.6 and Corollary 1.3. 


1.2. Some subalgebras of the Steenrod algebra. Let A be the 
Steenrod algebra over Z}. According to Milnor [7], the graded dual A* is 
a polynomial algebra on generators é. grade(é,) —=2"—1, n=—=1,2,---. 
If I is a sequence of non-negative integers, Sq’ will denote the element in the 
Milnor basis [7] corresponding to I. In particular, if we let A; be the 
sequence which consists of 1 in the :-th place, and zeroes elsewhere, we define 
Qi == Sq’, Ry = Sgt, grade (Q,)== 24 — 1, grade (Ri) = 2472. It is easy 
to verify that the elements Q,, Ry satisfy the following relations (here [z, y] 
= oy + yz): 
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(1.2.1) [9,9]; 
QQ; = 0, 
[By Ry] =0 (470), 
[Ro Bj] = Voi (740), 
RoBo = VoL 
. [Qo Bj] =0 (10), 
[Qo, By] = Qin. 
Let O be the subalgebra of A generated by 1 and Q, j—0,1,:--+, B 
the subalgebra of A generated by 1, Qo, Ru‘ + „Ru + for j==0,1,-°-. 
Let a*: A*—> A* be the squaring map in the dual of the Steenrod 
algebra—it is a Hopf algebra monomorphism. ‘It is clear that A*/a*(A*) 
is an exterior algebra on the classes of the generators é. The graded dual 
of A*/a*(A*) can be identified with C. Consider the dual of a*: 


(1.2.2) a: A>A., 


According to Lemma 2.4.2 of [2] we have proved statement (i) of the 
following proposition : 


-~ Proposrrion I.8. Let A, B, O, as above. Then CC BCA are inclu- 
stons of Hopf algebras, and 


(i) O<A, Kernel a = AC, 
(ii) BdA, Kernel a:a = AB. 


The proof of (ii) is just as easy, and is left to the reader. 


1.3. Computing Ext. We will need the groups Exta (Zs, Zs), where 
Eis B, C, Ao, Ai, C#, where B, C were defined in 1.2, A, is the subalgebra 
of A generated by 1 and Sq”, jn, and C* is the subalgebra generated by 
A, and C. i 

The algebra Exto** (Z, Za) is well known [7]: it is a polynomial algebra 
in generators q;€ Extot?™-1(Z, Ze). We shall use the standard minimal 
resolution [8] of Z, over C. Generators will be in one-to-one correspondence 
with finitely nonzero sequences of integers I (the free C-generator corres- 
ponding to I will be denoted by [Z]). Let I= (t,4,°-*+,t,° °°); then 
degree [I] = Sty grade [7] in — 1). The differential in the . 


minimal resolution is defined by 


(1.3.1) a] = Ola], 
where we set [I—A,] =0 if +0. 
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Let us compute Extz(Z,2,) using Theorem I.1. Since CCB, 
Kera | B= BO and C <B. We have that a(B) —(’, where O’ is C with 
the grading of every element multiplied by two. For the module X,, in 
(1.1.2) we take (see remarks after Corollary I.5) the free B-module on 
generators [I] 8 [J], where degree [I] =i, degree [J] =j, and grade 
[I] 8 [J] == 2 grade[I] + grade[J]. The augmentation & (1.1.2) is defined 
by a(H] @[J]) =0 if degree [J] 40, a([J] @[0]) = [Z]. Both d, and 
d, are defined by (1.3.1). 


Proposrrion I.9. We can define the maps dy for k= 1 as follows: 
a(S U) = 2 Rel — 41817] 
+2 (deer + 1) U — Ag] 8 [J — do + Ana], 


d,[I] ® [J]) =} (Jura +1) QH — åo — Ai] 8 [J + ân], 
ds ([7] 8 [7]) 


=È Om +1) (fea + 1) — Ao — An — Ar] @ [J H Aner HAm] 


-+ 2 Oft? [I — Ay — 2A;] 8 [J + Anl, 
dy = 0 for n Z 4; 


where j, denotes the k-th entry in J, and O,” is the binomial coefficient 
rl/s!(r—8)! . 


Proof. We have to show (see Theorem I.1) that 
eaha = ee gut, 
k 
2 dd 0, kl... 
Eo 


The first is easy to verify: e([I] 8 [J] ) 0, unless J = 0, and e(#[7] 8 [0]) 


UNS = 3 Que( [As] @ [I] = dee( 2] 8 I1). 
The second set of equations is more laborious to verify: 

(a) to show dod, + dida — 0; 
EAA 


am = Q,R,[I — Ax] & [J — Ag] 
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+2 (Gm +9 — Ax] 8 [J —Ao— As + Arn] 
+2 jera l — Ax] @ [J — Ao]. 
According to (1.2.1) QRe= RQ, if s 40, QoEr= RrQo + Qr thus 
dd ([I] ® [J] =L FQ — Ax] ®[J—A,] 
+2 (jrn + 1)9s IT — Ax] 8 [J — Ao — As + Arn] 
= dod; ([I] 8 WW); 
which proves (a). 
(b) To show dode + did; + dado = 0, we examine each term separately : 
doda ([] 8 [J]) =È (Gm + 1) QsQo[I — Ao — Ar] 8 [J — A; + Am], 
dd ([1] 8 [7]) = ZR BLT —A—A] @[J] 
=2, [Rs Ri] [I—A,—A ] 8 [J] 
+ 3 RBI — 244] [7], 
= 2 ual —Ao— As] @ [J], 
dado ({I] 8 [J]) = h (È QsL1)® [J —Ay]) 
= a (ie +9: — A — A] ® [J —A, + Ata] 
+ Zinn — A — Ai] 8 [J]. 
Thus (b) is verified. 
(c) To show dods + dids + dad, + dado — 0: 


doda ( [I] 8 [J]) = > 2, +1) (je +1) Q2[7 — ^o — Ar —A;] 
@ [J — A, + Ara + Ana] 


+ z Orr [I — Ao — 2A] Q [J + An — As], 
44,([1]® [J]) ~È (Jea + 1) Qo[Z—Ao— A] 8 [J + Am]) 
2 (ja +1) QoBs[I — Ao —A;— Ag] 8 [J + Ara] 
+S Gm +1) Ga + I) QoL — Ao — As — Ae] 8 [T+ An + Aver — do], 
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@ [J — Ay + Arı]) 
we (jess + 1) RQ [I — Ao — Ar — Ax] 8 [J + Ate] 
+È Um + 1) (ji + 1) Qo [I — Ao — A: — Ar] ® [J — Asser — Ao + Anis]. 
Thus | S 
(dda + dada) (IS ID= È (im +1) Qrn —- Ao — Ar Ar] 8 [J + AAi]. 
dado ( [1] 8 [J]) 42 Q] 8 Y—4,]) 


<= 2, ‚Gen +1) (ia + 1) Q — Ao — Ax — Ar] Q [J — As + Arn + Ar] 
Ret 


+2 Um) (jen + 1) Orn — Mo — Ag Ar] @ [+ Ata] 
HÈ Ge +1) (in) al — Mo — Ax — A] @ [J + Ana) 
re — Ay — 2A] 8 [J + 2An — As] 

+ 2 0t Qu — Ao — 2A;] 8 [J + Ans]. 


Thus (c) is verified, for O, + (j + 1) =—C,i*. 
(d) We ask the reader to verify that 
| dids + dsd, = 0, 
dado = 0, 
dads + dda = 0, 
dads = 0, 


which completes the proof of Proposition I. 9. 


Exts (Ze, Z2) is now computed by taking the cohomology of Homa(Y, Za), 
which can be identified with a polynomial algebra 


(1.3.2) P=Z,[ 2%, 2,° 2 Dp ag? Yp: á Jy 


where 2, is the element in the dual basis to the [I] @ [J] corresponding to 
[A]8 [0], and y; corresponds to the element [0] 8 [A;]; thus degree 2% 
=~ degree y; — 1. gradem = 2 - grade y = 242 —2. Let &ı=— Homs (d, 1). 
Then acoerding to Proposition I.7 we have &== 0 for 1>£1,3; & is a deriva- 
tion, 8 (z1) = & (Y0) = 0, &(y) = Yo}. Furthermore, 8; is a map of 
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Za[o, 2" * <, y ]-modules, 83(24) = ôs (Y0) = 0; if J is a sequence of finitely 
non-zero non-negative integers, we denote by y7 the monomial in the yrs, 
where the exponent of y+ is jx. Then 


8a (0) = E ijtotatrayl eso 
Kt 
+ > OaE a yA., 
A t 
We also have 5,8; 0, 8:83 + 83:8, = 0, 5980, (for (1.1.4) holds). 
Lemma 1.10. Under the differential 3,, P = M 8z, N, where 
M =2Z,[y,3, Yo", Zur y, u: I 
with zero diferential, and 
N—-Z,[z, Di 1 TH * "5 Yo] @z, Aly; Ya,’ Yp ‘] 


with differential è such that 8 is a derivation in N, è(z;) —8(y.) =0, 
Sly) = Yoz. (Here A[a,] denotes the exterior algebra over Z, on elements ay.) 


Proof. Immediate by inspection. 


The homology of N is easily computed. Since multiplication by y, is a . 
monomorphism in N, all -cycles will be found by examining the $-cyeles 
in the complex N/(y.), where 8° is the derivation defined by 8’ (2) —0, 
S (y) 21. This, however, is precisely the Koszul complex ([3], p. 153), 
which is known to be acyclic—it is precisely a minimal resolution of Z, over 
the augmented ring R=2,[2,2,° * ',2,° >°]. In particular, the only 
d-cycles are R-multiples of the basic cycles 


(1.3.3) FEN, 


where now J is a sequence of zeroes (first entry 0) and a finite number of 
‘ones. The only R-relations among the cycles & (y7) are R-linear combinations 
of the relations giving 8’5’==0. Return now to the complex N. Let x, yo 
denote the classes in H(N,8,) determined by zi, yo, respectively. Let U(J) 
be the class of ’(y’) (1.3.3). We have the following relations in H(N,8,): 


(1.3.4) Yoy == Q 4=0,1,--°°, 
22.074) =0, 
YoU (J) = 0, 


all other relations are R-linear combinations of these. We thus have: 
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PROPOSITION I.11. The homology of P (1.3.2) under 8 isa 
Zalo ty © 525° * *yHYol-module with 


Zlyd typ a @z, A[U (J)] 


as generating subspace. The basic relations over Z,[%,° * ',2u' * +, Yo] are 
given in (1.3.4). 


The homology of H(P,8,) under the differential induced by 8, is harder 
to handle. ‘ The method used will be illustrated in two special cases. 

Let By be the subalgebra of B generated by 1, Q, and Ru,‘ ‚Bu. A 
resolution for Z, over Bx is obtained by taking the resolution in Proposition 
I.9 and setting [I] ®[J]=—0 if some 40 for r>k or some j,~0 for 
s>k-1. In the cochain complex P (1.3.2) this corresponds to setting 
y=0 ii fj >k+1, n=0 if i> k. It is clear from the given form of the 
differential 8, 4-8; in P that i : 


(1. 8. 5) ar Exts’ (Za, Za) — Exts, (Za Za) 


is an epimorphism, and for ¢—s < 2}? —3 it is an isomorphism, because 
B =a By in gradings < At? — 2, 

For our purposes it will be sufficient to compute Exts, (Za, Z2). We 
have to determine the homology of 


(1. 3.6) Pi = Za{to Ti Yo Yo Yal 


under the differential 8, -+ 8», where 8, and 8; are as in (1.3.2). According 
to Proposition I.11, H(P,,8.) is a Z,[2,21,Y0]-module with Zu [yı, y,7] 
®A[U(0,1,1)] as a generating set and yo 1 = 0, yo 1 = 0, YoU (0,1,1) 
==() as basic relations. 

We can decompose H(P,,8,) under ôs into the following form: 


(1.8.7) K®@[L@,;M+Q+N], 


where K = Z,[y:*,ya*], dr = 0; T=—Z,[2], L=T@A[a,] 8 A[U(0,1,1)], 
dr =0; M=Z,[ 2, 2,7] 8 Aly, 427], dar derivation, dar(z;) =0, du(y/) 
a2; Q= Zoly], da= 0; N =Q Aly, ys"], dr—=0. The homology 
of M is readily computable: it is a Z,[z., zı?]-module with generators 1 and 
a, where ¢ == {ao74, + 27,7}, and relations Toa == 0, ToT? 1 == 0, £: 1—0. 

Since T is a principal ideal ring, we can readily compute H (L 8r M), 
by using the Künneth theorem [3]. Since L is T-free, and H (L) == L, we 
have H(L@,M) =H(L)8rH (M). 

Let us define the following classes in Extp, (Zs Ze): 
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qo = {Yo}; ko = {20}; kı = {21}, 

To = {Yyı? + %Yı}; T1 = {Yoya’ + TotYe}, l 
Tor == (Yoyı?ya? + TYY? + Loty: Ya}, 

yo {2042 + Tr}, w = {y}, w2 = {4:4}. 


PROPOSITION I.12. As an algebra, Exta, (Zs, Z2) is free as a Za[wi os ]- 
module on generators 


(1. 3.8) qo”, ka™t, qo”To, Qo”Tis Jo"To1; 
kity, kry’, kiy, n=0,1,2, 
ko, ko, kok, kok, koy, koy, kokıy, kokı?y; 
furthermore, the elements satisfy the following (incomplete) set of relations 
(1. 8. 9) To? = gow, ka? = 0, kèk, w= 0, Koro = 0, 
koy? — 0, Yoko m 0, gokı — 0, doy = kotka. 
Proof. Our computation H(P,,8,;8;) proves Proposition I. 12 additively. 
It remains to check that the appropriate classes represent the products claimed 


in Ext. This is easy to see from the resolution given in Proposition I.7 and 
the Yoneda definition of products (see [2]). 


COROLLARY 1.13. Exta,(Z2,Z2) is a free Z,[w,]-module with the fol- 
lowing set of classes as free generators: 


(1.3.10) qo”, Qo"ro, ko, ko”; 

furthermore, all relations are consequences of the following 

(1.3.11) Koro 0, Ko? = 0, goko = 0, To? = getan. 
Proof. Trivial computation. 


Since By=A,, we have computed Exts,(Z2,Z:). It is now easy to 
compute Exto#(Z,,2,). Let H be the subalgebra of C* generated by 1 and 
Qi, j= 2,8,'- +. According to relations (1.2.1), the elements of H and A, 

- commute in O¥, and 
(1.3.12) Cf = A9 H 
as algebras. The algebra Extz(Z,,Z,) is isomorphic to Z.[q:,:-+,Q,° °°] 


ju=2,38,-- +, degree(q;) =1, grade(q;) = 2/**—1. Since [8] (1.3.12) 
implies that j 
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(1.3.13) Exto#(Z,,Z,) = Exts,(Zs, Z2) ® Exta (Zz, Z2) 
as algebras, we have from Corollary 1.13: 


COROLLARY J.14. Exto#(Z2,Z,) is a free Zeal os, 93, qas: © ")-module with 
the set of classes (1.3.10) as free generators and (1.3.11) as a complete set 
of relations. 


Chapter IT. 


2.1. Cohomology of Thom spectra. Let MO be the Thom spectrum 
[8] for the orthogonal group; similarly, let MU, MSp, MSO, MSU be the 
Thom spectra for the unitary, symplectic, special unitary groups, respectively. 
Let 


(2.1.1) L—H*(MO;2,), M= H* (MU; Za), 
N = H*(MSp;Z,), U = H*(MSO;Z,), 
V — H* (MSU ; Z4). 


Let A be the Z, Steenrod algebra and «: A—> A the dual of the squaring 
map in A* (1..2). 

Proposition II.1 (Novikov). There exist Z,-module isomorphisms 
f:M>L,9:N>M,h: V>U such that the following diagrams are come 
mutative : 


A N ——N 48 FT ——F 
«os| |s «or |» 
A®M——M ABU ——U 
SR. 
A®L——L 


where the horizontal arrows indicate the action of A. 


Proof. We see at once that it suffices to prove the proposition for 
L==H*(BP°;Z,), M=H*(CP*;2.) N=H*(HP*;2,), where RP”, 
CP”, HP® indicate the infinite-dimensional projective spaces over the reals, 
coplexes and quaternions, respectively, with f and g algebra isomorphisms 
defined by f(y) =z, g(u) =y, where z, y, u are the generators of the poly- 
nomial algebras. But this is easy, using [7]: if 9€ A, 


or = X «En DT”, 
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and h: M>L,k: N— M defined by k{y) —z?, k(u) = y? are algebra mono- 
morphisms consistent with the action of A. But [7]: 


ba? = D, Én, a, 


hence, since k is an A-homomorphism, 
oy = = <En; a(#) 34 


or f(y) =a(#)f(y). Similarly g(Ou) = «(#)g(u), and the proposition is 
proved. 


Remarks. 1. The above proposition is proved in [11]. 2. L, M, N, U, 
V carry natural co-algebra structures (see [10]). The maps f, g, A in 
Proposition II.1, above, preserve the co-algebra structures. 


THeorem II.2 (Thom). As an A-module and coalgebra, L=A®S, 
where S* == Za[ T3" + "Tu ' | kR i for any t. 


Proof. That L is a free A-module was proved in [12]. A new proof 
which exhibits the co-algebra structure is given in [6]. The proof that L 
is A-free is very simple. We just notice (this was pointed out by W. Browder) 
that the theorem of Milnor and Moore (Theorem I.2, above) holds if # is 
just a coalgebra, since the proof in [9] only uses the diagonal in E. 


THEOREM II.3 (Wall). As an A-module, U is a direct sum of a free 
A-module and of modules with a single generator u and one basic relation 
Sq'u—0. The generators u are in one-to-one correspondence with partitions 
of non-zero multiples of four into multiples of four.. 


This theorem is proved in [13] in an indirect way from the structure of 
the unoriented cobordism ring N,. A direct proof is given in [15]. 

If H is a graded vector space, let us denote by H” the vector space iso- 
morphic to H but with every grading multiplied by two. Let H”’—(H’)’. > 
Consider A’ (resp. A”) as a left A-module via the map « (respectively aoa). 

Taxorem II.4 (Milnor, Novikov). As left A-modules . 

i) M=—A’O8’, 
li) NA” 88g, Sa i 
iii). V is a direct sum of A-modules isomorphic to A’ and modules 


tsomorphic to A’/A’Sq'; the latter occur in dimensions which are in one-to- 
one correspondence with non-zero partitions of 8 into multiples of 8. 
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Proof. Proposition II.1 and Theorems II.2, II.3. We remark that as 
an A-module A’/A’Sq! can be described as follows: it has a single generator u, 
and for #€ A, Yu—0 if and only if 9€ Kera + A Sg? = AÖF. 5 

In order to compute Ext (Z,Z,), where H is one of the modules L, 
M, N, U, V, it therefore suffices to compute Ext for the A-modules A, A’, A”, 
A/ASq?, A’/A’Sq!, respectively. l 


PROPOSITION 11.5. 


i) Exta(4,Z:)=1, 1€ Ext; 

ti) BExts(A’,Z2) = Zallo: 95° e 1, qe E Ext); 
iii) Extsst(4”,Z,) is given by Proposition I.12 for t—s < 13; 

iv) Bxtgt*(A/A8q?, Z2) = 2.190], qo € Ext; 

v) Exta(4A’/4'Sqt, Z2) is given by Corollary I. 14. 

Proof. i) is obvious; ii) follows from Corollary I.5 and Proposition 


I.8; iii) from Corollary I.5, Proposition I.8 and (1.3.5); iv) and v) from 
Corollary I.7 applied to A and Ao C*, respectively. 


2.2. The Adams spectral sequence. Let X and Y be finite CW com- 
plexes with base points. Let S™X == X + 8” be the m-th suspension. Define 
the stable track group {X, ¥}, to be Dir lim[S***X, 8"Y] under suspensions. 
Let p be a prime; denote by H*(X) the augmented cohomology with Z, 
coefficients. Let Kẹ be the subgroup of {X,Y}, consisting of the elements 
whose order is finite and prime to p. 


Turormm II.6 (Adams). There exists a spectral sequence 
{B,%*, dp}, Ert = Et (X,Y ; p) such that 


Br — Exta'(H*(Y),H*(X)), 
dy: Et Bpeti, 
{X, Y}_== Bom D Bruty. --D Bawen-.- 5 
where () Bons — K,, Beot/Bervte a Ht, and Bot is the limit of E,®t as 
& 


ro, 

The theorem is proved in [1]. The theorem remains true if Y is replaced 
by a spectrum satisfying certain finiteness conditions (see [8]). We shall 
consider the case X = §°, Y — MG, where G is O, U, Sp, SO, SU, respec- 
tively; then {8°%, MG}, = Dir lim rar (MG). 

If we let X = 8°, Y — 9°, we obtain the spectral sequence for the stable 
homotopy groups of spheres. The Adams spectral sequence for the sphere 
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operates on the spectral sequence for X =°, Y a spectrum. This can be 
described as follows. Let H be an A-module, then Extı(H,2,) is a right 
Ext, (Zp Zp)-module: that is, there is a natural map 


p: Exta? (H, Zp) Dz, Ezta” (Zp, Zp) > Extat (H, Zp) 


which gives the module structure. We write a» 8 for p(a®8). We shall i 
. need the following : 


THEorEM II.7 (Adams). Let a€ Hxts*(H*(Y), Zp), BE o a 
Suppose d,(B) = 0 in the N, sequence for the sphere for k =}, 3," 
Suppose dj(&) =0 for j=2,: : :,r—1. Then 


(2.2.1) d,{a* B} = {dra} * B. 


For a much more general result see the proof of Theorem 2:2 in 1.' 

Let p=2. Let qo € Exta™ (Za, Za) be defined by Sg. It is well known 
that go%5<0 for all n, and that qo is a d,-cycle for all k in the spectral 
sequence for the sphere. Furthermore, * g, corresponds to multiplication by 
2 in the #, term. 


2.3. The spectral sequences for the Thom spectra. Let p=2. 


Treorem II.8. All differentials in the Adams spectral sequence for 
MO, MU, MSO are identically zero. 


Proof. According to Proposition II.5.i) and Theorem I.2, #,%*—0 
if s > 0 for MO; hence all differentials are zero for a trivial reason. 

According to Theorem II.4.i) and Proposition II. 5.ii), H,2*—0 if 
t—s is odd in the case of MU. Hence again all differentials are zero, since 
dx changes the parity of t—s. x 

The case of MSO is equally easy. The modules ee give rise to 
“towers” obtained by multiplying with go (according to Proposition II. 5. iv)). 
The towers are never in adjacent values of ts, according to Theorem II. 3. 
It remains to show that if ae H,**, Be Hartt! ag, 740, 8 * qo-=0, then 
d,(B) a. This, however, is immediate from Theorem II.?: d, (8) =a 
implies d, (8% qo) =a * qo, hence a * g= 0, which is a contradiction. 

THEoREM II.9. Not all differentials in the Adams spectral sequence for 
MSU and MSp are identically zero. 


Proof. In both cases F: = Z.. If we can show that the image of the 
stable mod2 Hurewicz homomorphism is zero in dimension 8, then some 
differential must be non-zero on E,°*, The assertion about the Hurewicz 
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homomorphism is proved by considering the characteristic numbers of eight- 
dimensional manifolds which admit a stable Sp- or SU-strueture on their 
tangent bundles. In particular, such manifolds are stably complex, hence 
their chee numbers satisfy the following SUB [5]: 


— 2c, + ¢;¢,==0 mod4, 
— Ca F Cgc, + 3c2? E 4e: — at =0 mod 720, 
Gert 2t=0 modi? ` 
For a stable SU-manifold c, = 0, and since we are only interested in the 
characteristic numbers of a stable Sp-manifold, we may as well assume that it 


is 3-connected (remark of R. Lashof),. hence also here all characteristic 
numbers involving c, are zero. The congruences above therefore give 


—24=0 mod4, 

—,+3e,*=0 mod 720; 
in particular, . E l 
c==0 mod2, 


¢,7==0 mod2, 


and in both cases the Hurewicz homomorphism in dimension 8 is zero mod 2, 
which completes the proof of the theorem. 

Let us consider Ext,"*(A”, Z,) for t—s <9. Using Proposition IT. 5.iii) 
we exhibit these groups in the following table. 


TABLE 

8 : 

7 

6 wigo 
Š Tollo? wigo 

4 Togo wr 

3 qo? To kok, koy 
2 qè ko? koks y 

1 qo ko kı 

0 1 

st 


t—8—> 0 12 3 4 5 6 Y 8 
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It is clear that all differentials for t—s<7% vanish (arguments as for 
Theorem IL.8). It is easy to detern ine the group extensions in the # term. 
According to 8 there is no piri for p> 2 in the homotopy of MSp; 
thus we have: 


THEOREM II.10. The first seven homotopy groups of MSp are: 


‘ k 0 1 2 3 4 5 6 
Tk Z Ze Zs 0. Z Za Zs 


THR UNIVERSITY OF CHICAGO 
AND 
THE INSTITUTE FOR ADVANCED STUDY. 


REFERENCES. 





[1] J. F. Adams, “On the structure and applications of the Steenrod algebra,” Oom- 
mentarts Mathematict Helvetici, vol. 32 (1958), pp. 180-214. 

» “On the non-existence of elements of Hopf invariant one,” Annale of 

Mathemattos, vol. 72 (1960), pp. 20-104. 

[3] H. Cartan and S. Eilenberg, Homologtoal Algeba, Princeton University. Press, 
1956. 

[4] S. Eilenberg, “ Homologieal dimension and syxygies,” Annals of Mathematics, vol. 
64 (1956), pp. 328-336. 

[5] F. Hirzebruch, “Komplexe Mannigfaltigkeiten,” Proceedings of the International 
Oongress of Mathematicians 1968 (Edinburgh), pp. 119-136. 

[6] A. Liulevieius, “A proof of Thom’s theorem,” Oommentarit Mathematict Helvetioi, 
vol. 37 (1962), pp. 121-131. 

[7] J. Milnor, “The Steenrod algebra and its dual,” Annals of Mathematios, vol. 67 

(1958), pp. 150-171. 

„ “On the cobordism ring Q» and a complex analogue,” American Journal 

of Mathematics, vol. 82 (1960), pp. 505-521. 

[9] J. Milnor and J. C. Moore, “On the structure of Hopf algebras” (to appear). 

C107 8. P. Novikov, “Some problems in the topology of manifolds connected with the 
theory of Thom spaces,” Doklady Akademii Nauk SSSR, vol. 132 (1960), 

pp. 1031-1034 (translation in Sovtet Mathematios, vol. 1 (1961), pp. 717- 

719). 


[2] 








[8] 


[11] 

[12] R. Thom, “ Quelques proprietes globales des varieties differentiables,” Commentarii - 
Mathematici Helvetici, col. 28 (1954), pp. 17-86. n 

[13] ©. T. O. Wall, “Determination of the cobordism ring,” Annals of Mathematics, 
vol. 72 (1960), pp. 292-311. 











[14] » “Resolutions for extensions of groups,” Proceedings of the Cambridge 
S Philosophical Society, vol. 57 (1961), pp. 251-255. 
[15] , “A characterization of simple modules over the Steenrod algebra mod 2,” 


Topology, vol. 1 (1962), pp. 249-254. 


» “Homotopy properties of Thom complexes” (dissertation; unpublished). -. 


A COMPLETE DESCRIPTION OF THE NORMAL SUBGROUPS 
OF GENUS ONE OF THE MODULAR GROUP.* 


By Morris NEWMAN. 


Let T be the 2X 2 modular group: that is, the totality of linear frac- , 


tional transformations 
peat 
. f 4 er -+ a 
where a, b, c, d are integers and ad—_bc—=1. It is known that T is the free 
product of a cyclic group of order 2 and a cyclic group of order 3, 
T= {z} + {y}, Py =i. 


T may be represented as the multiplicative group of 2 X 2 rational integral 
matrices of determinant 1 in which a matrix and its negative are identified. 
If u is an element of T then & will denote the matrix corresponding to u 


under this representation. Then the representation may be chosen so that 


Ti 


1 0 
and setting 
: 2 — DY, 
= — 1 i): G d 
SIR, Del 0 1)° 
Thus f 


We shall write {u,v,- + -} for the group generated by u,v, 
T == {z, y } s } 
Let @ be a normal subgroup of T of finite index p, and define n == n (G) j 

as the least positive integer n such that the substitution ‘ 

=r + Nn 
(equivalently z”) is in G. Then except for the groups T, T°, T? (Tr is the 
subgroup of T generated by the r-th powers of the elements of T) the genus g 
n—6 





der" 
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of the associated standard fundamental region of G is given by the formula ~ 


(see [1] for an excellent discussion of this topic). Thus if g1, it follows 
that there are only finitely many possibilities for „ and n and consequently 
only finitely many possibilities for @, since it is known that a finitely generated 
group possesses only finitely many subgroups of a given finite index (see [2]). 
For g = 1 however no condition is imposed on p, but n must be 6; and there 


are actually infinitely many normal subgroups of T of finite index and genus 1. 


These can be classified by uniformization theorems, but the results tell almost 
nothing about their group-theoretic structure. It will be the purpose of this 
article to determine their group-theoretic structure completely in terms of 
three integer parameters. . 

The first and second commutator subgroups of T will be denoted by I’, 
I” respectively. Then (see [4] and [6]) 


Lemma 1. The commutator subgroup T of T is a free group of rank 2, 


. and 


i ` t 5 i. 
(1) (T: I) = 6, T = Dal’, = (ayay", tag). 
We set 
gay, baaytay. 


"Then a and b have the matrix representations 


ic (e 7) Be (3 >) 
> NE ay? 1 2 
From Lemma 1 it follows that T” is & free group of countably infinite rank 
and of infinite index in I” (see [3], vol. 2). Furthermore, T’/T” is the free 


abelian group of rank 2 on the generators ar”, bI”, 
If w is any word of I” then (w), e,(w) will denote the sum of the 


. exponents of a, b respectively. I” is characterized by ea(w) == é,(w) = 0. 


If u, v are elements of T then we shall write 
. . uv if and only if uv? € r”. 
Thus if 1, v€ T% then u==v if and only if 
oa(u) = eolo), au) al). 
We will need l 


Lumma 2. Let A(6) be the smallest normal subgroup of T containing 
2°. Then A(6) == I”. 
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The proof is given in [5]. It depends on the observation that I” is 
generated by a and b, and the commutator abab € A(6). Thus A(6)> I”. 
But A(6) is contained in any normal subgroup of T containing 2° and 2° € I”, 
so that A(6) CT”. Hence the conclusion. 


Lemma 3. Let w be any word of T and define the conjugacy 
S(w) = zwr. . 
Then 8 is determined from 


(2) saws. Ben 


The proof is straightforward, and follows from the decomposition of T 
modulo IY given in (1), Lemma 1, and a small computation. 


Lumma 4 Let G be a normal subgroup of I’. Then G is a normal 
subgroup of T if and only tf zaz C G. 


The proof follows directly from the decomposition of T modulo I” given 
in (1), Lemma 1. 


Lemma 4 is used in the proofs of the theorems that follow to determine 
under what condtions a normal subgroup of I” is also a normal subgroup 
of T, occasionally without explicit mention. 


. 


Lumma 5. Let G be a normal subgroup of T, GD IT”. Suppose that 
atanbi€ G, atatbae G. Then gtragnteshtitts € G, 


Proof. Since G is a normal subgroup of T and zabt e G it follows 
that atbisgrae G. Hence etatbhassbtegtse G, and thus 2tsaubhassbts€ G, 
But atbtgehtss= qatahhtts, and I” C G. 

Thus the lemma follows. 


We are now ready to prove our first theorem. 
THEOREM 1. Let G be a normal subgroup of T of genus 1. Then 
ogor. 


Proof. Since G is a normal subgroup of T of genus 1, the exponent of. 
z modulo Gis 6. Thus z°€ G and it follows that @ D A(6). Hence Lemma 2 
implies that G D r”. 

Now suppose that g is any element of G. By Lemma 1 we may write 
(8) g=rg, f Er, 0SrS5 
and hence 
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g=zarbig”, g’EI". 
Since I” C G, it follows that 


w= zabt E G. 


Since @ is a normal subgroup of T, S (w) € @. Using Lemma 3 and keeping 
in mind that G D T” we obtain 
i w= z"atbt € G, 

S(w)=zrarttbseG, 

S? (w) = zabt E G, 

S (w) = zabt E G, 

S*(w) =zra etb E G, 

S (w) =za tbt E G. 


Then Lemma 5 implies that 2° € @ (since w and S*(w) belong to @) and 
that 2° € G (since S(w), S’(w) and S*(w) belong to G). It follows that 
zr€ @. But z is of exponent 6 modulo GandOSr=5. Hence r= 0, and 
(3) implies that g € I”. Hence @ C IY and the proof the theorem is complete. 

The determination of the normal subgroups of T of finite index and of 
genus 1 is therefore reduced to the determination of the normal subgroups 
of T' of finite index contained between I” and T”. Throughout the remainder 
of this article we shall assume that @ is a normal subgroup of T (not neces- 
sarily of finite index) such that ID GDI’, GT” We are going to 
study the quotient group G/T” which is abelian since IY D GD I”. 

We first prove 


Taxorem 2. G/T” is the free abelian group on 2 generators. 


Proof. T’/T” is the free abelian group on the two generators ar”, bI” 
and G/T” is a subgroup of IY/T”. Hence G/T” is either cyclic or the free 
abelian group on two generators. Assume that G/T” is cyclic, with generator 
abr”. 

Since @ is a normal subgroup of T there must be an integer k such that 

S (atb*) = (a*b*)*, 
(4) ae 
(ab-*) tat = (a8b*)*, 
From (4) we obtain that 
(k—1)s—t=0, 
s+ kt =0, 
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which is possible if and only if s=t=0. This implies that -G == I”, which 

is excluded.. Thus G/T” cannot be cyclic. Hence @/T” is the free abelian 

group on two generators AT”, BT” and the proof of the theorem is concluded. 
We go on now to our main theorem. — 


_ Termorem 8. There is a 1-1 corespondence between normal subgroups 
Q of T such that YD GDI”, GAY” and ordered triplets of integers 
(p,m, d) where 


(5) = p>0, 0<m<d—1, m +m +1==0 (mod å). 
The correspondence arises from the coset decomposition’ 
(6) Q = 5, ABIT”, A arb, B= be, 


Proof. Suppose that AT”, BT” are generators of G/T’. It is known 
that if U, V are independent generators of an abelian group then so are 
UVP, UYY? if and only if a, £, y, 8 are integers satisfying a — By = + 1. 
This implies that A and B may be chosen of the form 


A=abt, B=br, 


Since @ is a normal subgroup of T, S(A)€ G, S(B)eE G. Hence integers 
k, I, s, t exist such that 


S(A) = A*BY, §(B) = AsBe, 


Tf we use (2) and follow the now familiar procedure of comparing exponents, 
we find that S(A)E G, S(B) €G if and only if integers p, m, d exist such 
that 

(7) A == abm, B=b#, m’+-m-+t1==0 (modd). 


Since A may be replaced by A! and B by B it is clear that both p and d 
may be chosen to be positive (certainly pd>£0); mod since A may also be 
replaced by AB*, m may be chosen modulo d. 
In this fashion we obtain at least one decomposition (6) sharing (5). 

We shall show that for any given G there cannot be another decomposition 
(6) satisfying (5). For suppose that 


Gm $ A $B T”, Ao = abr, By = bhr 
with 
Po > 0, Sms d)—1, MF + m +120 (mod do). 


Since AT”, BT” and A,T”, B,T” are pairs of generators of T/T” there are 
integers a, ß, y, 8 such that «5 — 8y = + i and 


No. i n 

ee H Ey r ENE A 

E ee ee a 
. De ORD 
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Ao==A°BP,. By = AB, 
l Comparing Se we find that 


ac 


But (“ e) is unimodular and each of the matrices G in) & 
A 0 dopo. /? \0 dp 


ig non-singular and i in Hermite normal form. _ Hence they are ) identical and 
( B J is the identity a 

Hence we have shown that the triplets (p,m,d) and (Po, Mmo, do) are 
identical. Thus to a given group G corresponds precisely one decomposition 
(6) satisfying (5). 

The converse is clear since conditions (5), (6) and Lemma 4 imply that 
G is a normal subgroup of T such that IY D G DT” and GT”. Furthermore 
@ is determined by its coset decomposition modulo T”. 2 

It is of interest to determine the decomposition of I” modulo G. We have 


THEOREM 4. G is of finite index dp? in I’, and 


T = Sarde. 
0sSrsp—1 
OSs S< dp— l1. 
Before proving Theorem 4, we note the interesting corollary 


COROLLARY 1. Any normal subgroup G of T different from I” such 
that z is of exponent 6 modulo G ts of finite index in T. 


Proof of Theorem 4. Since G, T” are normal subgroups of I’, 
(8) EIER AIR 


Now T’/T” is the free abelian group on the generators al”, bI” and a/r” 
the free abelian subgroup of I“/r” on the generators aPb™?I’’, b%r”. By 
standard results from the theory of abelian groups and the isomorphism (8) 
it follows that T’/G is.of order 


P EDN te 

| act (2 Al ap 
and that ab, 0 Sr S p— 1, 0 S s S&S dp—i form a complete set of inequiv- 
alent representatives for I” modulo G. The proof of the theorem is concluded: 
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It is of interest to note that @ is not determined by its index in I’ nor 
by the coset decomposition of I” modulo @. For a fixed index (P: @) 
= p = dp*, the number of possible groups G is just ` 


(9) , 
Pig m&m+1==0 (mod #/ p9 
0SmSp/pt—1 
It is of some interest to pursue this a little further. Let é(n) stand for 
the expression (9). Then it is not difficult to show 


THEOREM 5. Let é(p) denote the number of normal subgroups of T 
of index 6u and genus 1. Then é(p) is a multiplicative arithmetic function 
of p with values at the prime powers q” given by 


1 —1)" 
item a 


&(q) = . ge 


IE, mal (AH (g/8)) >. 


Here (g/8) is the Legendre-Jacobi symbol of quadratic reciprocity. 
Another interesting characterization of G is given by the corollary that 
follows: 


COROLLARY 2. The group G consists of all words w of I” such that 
(10) &(w) =0 (mod p), &(w) =me,(w) (mod dp). 
For m==0, d=1 (p,m,d) becomes (p,0,1) and (10) becomes 
€q(w) = e (w) =0 (mod p). 


The groups so obtained were introduced in [4] and were denoted there by 


T (p,p). 
The principal congruence subgroup T (6) is of genus 1 and of index 72 


in T, and so of index 12 in I”. Thus dp? = 12 for T(6). It is not difficult 
to show that the only solution of (5) for dp? = 12 is 


(2; m, d) T (2, 1, 3). 


Thus T(6) may be characterized as the totality of words w of IY for 
which 


(11) e(w) =0 (mod2), ¢,(w) ==e,(w) (mod6). 
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Restated, (11) merely says that 
l ea(w) = e,(w) =0, 2, 4 (mod 6). 


‘In conclusion we remark that @ is a free group of rank 1-4 dp*, since I” 
is a free group of rank 2 and (T: G) = dp. 
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ON THE INTEGRAL REPRESENTATIONS OF QUADRATIC 
FORMS OVER LOCAL FIELDS. 


By Cart Rızau.* 


A quadratic form obtained by making a linear substitution of new 
variables for the variables of a given quadratic form Q, is called a repre- 
sentation of Q. One of the problems of the arithmetic theory of quadratic 
forms is to determine the representations of a quadratic form when the 
coefficient domain is an algebraic number field, the ring of integers in such 
a field, or a p-adic completion of either of them. The p-adic fields and the 
power series fields in one variable over finite fields, are usually called local 
fields. l 

Hasse [1] gave the solution for this problem over the rational and p-adic 
fields. The solution for number fields and p-adic fields can be found in 
Introduction to Quadratic Forms [4], by O. T. O’Meara, a book which answers 
the need for an account of the modern theories of equivalence and the orthog- 
onal group, in the arithmetic case. Jones [2] gave a partial solution to the 
representation problem over the p-adic integers when p is odd; O’Meara [3] 
extended and generalized these results to include all rings of p-adic integers 
in which 2 is a unit or a prime. The present paper gives necessary and 
sufficient conditions for one form to be represented by a “modular” form 
over any ring o of p-adic integers in which 2 is not a unit (thus 2 may be 
ramified) ; a quadratic form Q is modular if there is a field element æ such 
that aQ has integral coefficients and unit discriminant, i.e. «Q is unimodular. 

Now suppose that q and Q are two non-degenerate forms with coefficients 
in o. If q is to be represented by Q integrally, i.e. over o, then it must 
certainly be represented by Q fractionally, i.e. over the field of quotients F 
ofo. Let us assume this is the case. Denote by Q (o) the elements represented 
by Q for integral values of its variables. Let Q* be the form whose symmetric 
matrix of coefficients is inverse to that of Q. (Thus the coefficients of Q* 
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may not be integral). Suppose a!Q is unimodular, and let 8 be the greatest 
common divisor of the entries in the symmetric matrix of g. If qg and Q 
have the same number of variables, the First Main Theorem (end of $6) 
gives necessary and sufficient conditions for q to be represented by Q. With a 
few exceptions, these conditions are Bo Cao, g(0) E Q(o) and Q*(0) C g*o); 
stronger conditions are necessary in some circumstances. From this and 
Theorem 6.12, we get the Second Main Theorem: Let Q be unimodular and 
q modular with the same (arbitrary) number of variables; then g is represented 
by Q if and only if g(0) CQ(0) Cq¥(o). 

Now let y= (number of variables of Q) — (number of variables of q). 

The Third Main Theorem (87) deals with the case v>0. If y=1 or 2, 
a form g’ with v variables is determined (virtually canonically) from q and Q 
with the property that q is represented by Q if and only if q+ g is. Then 
the First Main Theorem can be used to test if q+ g is represented by Q. 
If v= 8, then necessary and sufficient conditions for representation are 
Bo Cao and g(0) CQ(o0). 
The statements of the First and Third Main Theorems do not involve 
the sets g(0),Q(o),: > >, but rather the additive subgroups of F generated 
by them. These so-called norm groups are much easier to determine (both 
in theory and in practice), and moreover they yield “stronger” theorems in 
the sense that a theorem remains true = the norm groups in its statement 
are replaced by the sets g(0),@Q(o),° > 

A result of somewhat different nature than the Main Theorems is Theorem 
5.1 which describes how a representation is actually effected. 

The language used in this paper is not that of quadratic forms, but 
rather that of the equivalent notions of quadratic spaces and lattices. §8 14 
introduce this language and give the preliminary results needed. 885-7 
contain the main results. The paper is concluded with a few remarks and 
partial results on the (still unsolved) problem of the representations of an 
arbttrary quadratic form Q. 

. Full proofs and more detailed explanations for the statements of §1 
and §2 are to be found in [4]. 


1. Basic theory. The field F is a finite extension of the 2-adic numbers. 
The (unique) exponential valuation of F is written as |a|, (a€ F), while 
the corresponding logarithmic valuation is orda, (“order of a”). The ring 
of integers in F is o, m is a prime element (fixed from now on), p==o is 
the unique. maximal ideal of o, and u is the group of units. The residue class 
field o mod p is a finite field of characteristic 2, and is.therefore perfect. The 
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order of a fractional ideal p* is ord p* == k, (k a rational integer). If A and 
B are non-zero field’ elements or ideals, then A ~ B means that ord A==ord B 
mod2; we also use the negation of ~: ÁA ~+ B, and we adopt the convention 
that 0--A if A is non-zero. Thus for example, 1—~ a, wet pm, 

If a quadratic form over F is given by means of a symmetric n by n 
matrix [ay], then a quadratic space associated with this form is an n-dimen- 
sional vector space V over F provided with a bilinear form B: V X V— F such 
that B (£, zi) = ay for some basis 24, --,t, of V. We set B(x, z) = Q(z). 
To show the relationship between [ay] and V, we write V = <[ay]> or simply 
Y = [ay]. If S, and S, are two subsets of V, write 


B(S,, 82) = {B (z,y) | gE 81,4 € 82}. 


I B(8,,8,)=0, S, is orthogonal to S} An isotropic vector is one which 
is orthogonal to itself: Q(z)—=0. The radical of a space U is its subspace 
rad U consisting of those vectors z orthogonal to the whole space: B(z, U) =0. 
A space is regular if its radical is zero. We shall write V=U1W if V is 
the direct sum of the mutually orthogonal subspaces U and W. Ii Us <%!y, 
Ws <Ns, (M and N symmetric matrices), we write Va <M>i<N> 


= y | 4 . Now let S* be the subspace V orthogonal to the subset S of V. 


If U is a regular subspace of the regular space V, then V = U | U*; from this 
we can deduce that any space V has an orthogonal basis: V = Fy, L’ © -1 Fyn 
Now define dV to be det[ay]. The discriminant dV is uniquely determined 
up to multiples of non-zero squares of F. If « and 8 are two determinations 
of dV, then ay? for some non-zero y€ F, and we shall write dV = a = B. 
This notation is consistent with that introduced in §2, i.e, «== ß means 
precisely that the quadratic spaces <a) and <P> are isometric. 

A lattice L in a quadratic space V is a finitely generated o-module in V. 
A lattice.is always free, i.e. there exist k linearly independent vectors 
Yo c, Yyy such that L==oy,-+----+oy, If we let @ be the k by k 
matrix [B(y, y;)], then we write L = <p> or simply L=(, and we define 
dL to be det @. This time dL is uniquely determined by L up to squares of 
units and we adopt the conventions for it analogous to the field case. A vector 
ze L is maximal if m's L; any maximal vector x belongs to some basis 
of L. The subspace of V generated by L is denoted by FL; we say that L is 
a lattice on Vif FL == V. We define dim L = dim FL = the dimension of FL. 
Every line Fy of FL contains a maximal vector of L. Note that dL=a 
implies that dFL =g. We write L =J LK if L is a direct sum of mutually 
orthogonal lattices J and K; the latter are then called components of L, and 
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we also write K=J*; J (or K) is also said to split L. The radical of L, 
rad L, is the sublattice of L consisting of all vectors orthogonal to L. We 
have rad L = 0 if and only if dL=<0, and if this is the case, L is said to be 
regular. We define the volume of L to. be bib==dL-o. Then if K and L 
are regular lattices on the same space, K D L implies bK D vL, and KƏL 
is equivalent to DK Dbl (if KDL). Finally we denote by V*%, (a€ F), the 
tector space V provided with a new bilinear form B*(z,y) =aB(z,y), and 
we say that “ V has been scaled by a.” And L° will be the old lattice L with 
the new bilinear form. 


2. Isometry and representation. A linear map o: VV’ between 

quadratic spaces V and V’ with bilinear forms B and B’ is called a represen- 
tation if B’ (oa, cy) =B(z,y) for all z,y¢ V. If it is one to one and onto, 
it is an isometry and we write V = V’. There are splittings V == U Lrad V 
and V’—U’ | rad V’; one can then show that V — V” (i.e. there is some 
representation o of V into V’) if and only if U —> U’. Since U is regular, 
any representation o: U —> U’ must be an isometry of U with oS, i.e, U’ 
actually contains a replica of U. An important and basic theorem is Witt’s 
Theorem: If V1 L Vase Vi L Vy and Via Vy’, then Voc Vy’. 
'. The problems of representation and isometry of two quadratic spaces V 
and V” have been completely solved over local fields. By what has been 
said above, it is possible to assume that V and V’ are regular. The invariants 
which characterize the isometry class of such a space V are the obvious ones, 
dV and dim Y, plus a third, the so-called Hasse symbol SV. We shall not 
use this last invariant explicitly in this paper, and therefore will drop the 
matter here. However we shall use the conditions for representation, which 
we now list. Let v= dim V’—dimV=0. Then V>V’ tf and only tf 


(Gi) VeV’ if y=0 
(ii) VicdV-dV’y=V’ . ifvol 
(iii) dV =— dv’ implies that FM 1 Vc: V’ if y=? 

(V7 V’ always tf v= 3). 


Here FH is the quadratic space FH = E ae 


The definitions of representation and isometry of two lattices L and I/ 
are the same as for quadratic spaces. Once again we can restrict our inves- 
tigations to regular lattices. (See pp. 845-846 of [3]). A representation 
L>L’ can always be extended to a representation FL— FL’, so that this 
latter condition is a necessary one for L—->J/. Also if oc: LoL’ is a 
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representation, then the regularity of L implies that L=oL, so that I 
contains a replica of L; the converse is also true. 

For any lattice L, 3L=B(L,L) is an ideal, the scale of L. Similarly, 
the ideal nL = Q (L) -o is the norm of L. We have 2(8L) CnbCab. A 
lattice L is called unimodular if its associated matrix of coefficients is uni- 
modular, (integral entries, unit determinant). L is a-modular if L* is 
unimodular, where 8L == q — ato. Every lattice has a Jordan splitting as 
follows: ; 

Lee D i Lalo ++ LL 


where each component L; is modular, and 8L, D81,D-:'D3L. U 
L=K,lK,l'''LK, 


is any other such splitting, then s= t, dim K, dim Ly bly 8K, nly 
== 8L, <> nK, = 8K, for 1SiSt. . 

A lattice L is called a-mazimal in the space V (a an ideal) if nl Ca, 
and if KDL (K another lattice in V) implies nK Da. It can be shown 
that FL=V if L is a-maximal in V. Also if L is any lattice in V with 
nL Ca, then there is an a-maximal lattice on V which contains L. The 
principal result concerning maximal lattices is Hichler’s Theorem: Any two 
a-mazimal lattices on the same space V are isometric. 

The norm group gL of a lattice L is the additive group Q(Z) + 28L. 
O’Meara introduced the norm group, and used it to characterize modular 
lattices: Two a-modular lattices on the same space are isometric if and only 
if they have the same norm groups. He has also determined the isometry 
classes of lattices in general, but we shall not need these results. 





3. Norm groups and modular lattices. We shall have to know quite 
a bit about modular lattices, particularly about their canonical forms. This 
section is devoted to a summary of these facts. Most of the results will be 
stated for unimodular lattices—their restatements for the modular case are 
usually quite obvious. 


A very useful concept is that of the quadratic defect b(a) of a field 
element æ. It is defined as b(a) —=M-yo where y runs over all solutions 
(By) of a==f?-+ y. It follows immediately that 5(é«) = 5(a), 5(a) 
Cao, (a) ao if and only if a~r. One can show (63:2, [4]) that the 
possible defects of a unit are 


0 C 40 C 4p7 C4p3C--- Cp. 
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To show this, the Local Square Theorem (63:1, [4]) is necessary: For any 
integer a, 1-+4ra is a square. Also there is essentially only one unit 
A == 1 — 4p of defect 40: all other such units are of the form eA, «€ u, (63:4, 
[4]). We shall fix this unit A, and we note in addition that p can be 
taken to be a square. Finally by 63:5 of [4], TR if een, 
|4|<|a| <1, and a~r. 

An easy application of quadratic defect (63: 11, [4]) is the following: 


Lemma 3.1. If V ts a binary space with dV ~m, and tf a is a non- 
zero field element, then Q(V) contains a or aA, but not both. 


Definition 3.2. A norm group g is a non-zero additive subgroup of F 
which is bounded, i.e., | | is a bounded set of real numbers, and which admits 
square integers as operators: 0°g G g. 

.Throughout this paper, o° will stand for {a? | @€o}, and: not for the 
ideal product o'o. Note that it follows directly from the definition that 
the sum or intersection of two norm groups is another norm group. In §2, 
we defined the norm group gL of a lattice L as gd = Q(L) + 28L; this is 
easily seen to be a norm group in the sense of Definition 3.2. In fact it is 
the norm group generated by Q(L). 

If g is a norm group and «€ g, then 200 Cg. Indeed 


Aa (1+-A)2a— a—A¥ae g 


for any A€ o. Thus g contains elements of either order parity. If a€ g is an 
element of largest value |a|, (a exists since | g| is a bounded discrete set), 
then a is called a norm generator of g. An element bE g, b-a, with the 
property that |b] is largest for all elements in g with different order parity 
than a, is called a base generator of g. Since 2ao C g, we have |b | > | Ara |. 


Lemma 3.3. If a ts a norm generator and b a base generator of the 
norm group g, then g = ao? + bo and brn is the largest ideal contained in g. 


Proof. Clearly ao? C g. Choose «€o such that |a°a |= | br], and 
let cE bro. By Lemma 3.1, we can find é, yE F such that c=a?a + „*b 
mod4co. Since | ga*a| cannot be equal to |7%b|, both é and y must be 
integers, and therefore c€ g since 4co C 2boC g. Thus a +boCg and 
bx*o is the largest ideal in g since br*¢ g by choice of b. A similar argu- 
ment (cf. 93:4 of [4]) shows that g Cao? -H bo. And so g= ao? -+ bo as 
required. 

We now adopt the convention that whenever a norm group g is expressed 
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in the form g == a0? + bo, then a is a norm generator and b is a base generator. 
It should be remarked that the. base generator is not quite identical to the 
weight generator defined by O’Meara in $93A, [4]. For suppose that 
g= gL is the norm group of a lattice L, and let b be a base generator. Then 
b is also a weight generator unless b € 28L, in which case br! is a weight 
generator. 

For both practical and theoretical reasons, it is important to be able 
to calculate the sum and intersection of two norm groups g: == 4,07- 6,0, 
82 = Q20? + bo. Consider first the sum. Let a be the larger in value of a, 
and a, and define b by bo = X ab (ac) where c runs over Q,, bı, ds, bs. Then 
gı + ga = a0? + bo, (the proof is similar to that for the formula for w on 
p. 280 of [4], and is omitted). Now the intersection, A norm generator is 
the largest element contained in the intersection, while a base generator is 
the larger in value of b, and'b, (by the characterization of the largest ideal 
in a norm group, given in Lemma 3.3). 

We now wish to discuss canonical forms. First let us write C;,(a, 8) for 
the p‘-modular matrix ® A ; thus œ, BE pt and | + a8 | = |7]. 
Q(x, 8) is usually written @(a,8). Now let L be a binary unimodular 
lattice, a any norm generator of L in Q (L), and suppose that dL =— 1- 8 
where d(1—8)-=80. Then by 93:17 of [4], L = A(a; 3st). If K = Qa, p) 
where nK=ao and d(m— aß) —aßo, then we shall generally write 
K = @,(a,8). Thus in the above example, L= @(a,8a*). If eis a unit, 
then 6,(27*e,0) = ,(0,0) by O’Meara’s theorem on modular lattices (82), 
since their norm groups are equal (namely to 20), and their associated quad- 
ratic spaces are isometric. We also write (,(0,0) as X, and H, as &. u 


LEMMA 3.4. Suppose L=$(a,%ra) where a€o. If c€20, then 
L= (a-c, 2x8) for some BE 0. 


Proof. Consider the equation ZraX?+2X—c=0. If a0, it has 
an integral solution == łc. If a40, it has solutions é, n€ F by Hensel’s 
Lemma (13:8, [4]) since c€ 20. Moreover one of them, £ say, must be 
integral since | £+-»|2-|&|. Suppose L = Q (a, ra) in the basis z, y. Then 
L=(d(a+ 0,278) in the basis s ==g -+ fy, Y=ye!, where e is the unit 
B(z + éy,y). l 

The phenomenon |a+8|==|a| if |a|> |] is often referred to as 
the principle of domination, or simply domination. We want to extend the 
use of this term to another similar situation. Namely suppose that L = @(a,c) 
where ac>£0, and let a = €a4-2&-+77c€ Q(FL). Then 
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|a| = mac{| &a |, | 9c |}. 


To prove this, first note that |4| |ac| <1. Suppose that | a | > |*e |; 

then | 4€y? | S | acé*y? | < | @a|? whence | 2&| < | £a | and the result follows. 

A similar calculation proves it when | @a|<|y’c|. If | @a|—| n%c|, then 

we must have | ac| =| 4], i.e., aL =— A =— 1 + 4p. It is easy to check 
that | 2a|==|2é)| also. Now suppose that 


Eat? + y?c=0 mod @ap. 


Then there is a solution for X?a 4+- 2X +c(1+7)=0 for some w’€p. 
A straightforward calculation using the Local Square Theorem shows that 
the discriminant of this equation is 4Ae? where e is a unit. This is a contra- 
diction since the discriminant is non-square, so the equation has no solution. 
Therefore | a | == max{| £a |, | nc |} as required. 


Lemma 3.5. If L= @(a,b) with |b|2|2|, then 
L= {ze FL | Q(z) €-gL}. 


Proof. Let c= a+ 2&-+7%b€ gL. Then £€0 by domination. If 
ab € 40, then similarly „€o. If ab¢4o, we have gl —ao*-+ bo, and so y 
is an integer since c€ gL implies d(ac) C abo. 


Lemma 3.6. If Lo @(a,6) with ab~ r, then L contains a bp*-maaimal 
lattice. 


Proof.. Define r= 0 by |x**a|==|b|, and suppose that L= 6 (a,b) 
in the basis z,y. Then M=orz+oyCL and M = @,(n*a,b). Also 
gM = nM = zao and |b| =| 2a"| since |ab| > |4|. The lemma follows 
by Lemma 3.5. 


Lemma 3.7. Let V bea binary space with dV = —1 -+ 8€ u, d(1— 8) 
== ĝo D 40, and let a be any field element. Then.a(1+d)EQ(V) for some 
dé 45-0; and if dE 48+p, then a€ Q(V). 


Proof. By scaling V, we can assume that a—1. Of all units in Q(V), 
let e=1-+-d be that one with least quadratic defect do. Suppose that, 
d ¢ 450. Consider the lattice L= @(«,8e*) on V. Since the residue class. 
field is perfect, we can find ¢¢€ F such that &8e?==— d mod dp. Then the 
unit de 2€-+ et is in Q(V) and d(E) C do, which contradicts the 
choice of'e. This proves the first part. 

To prove the last part, we assume that d>£0, dE 487p. Then the unit 
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is in Q(V) and de) C do. This is a contradiction and 80 “the lena. is 
completely proved. ; 


3.8. Remarks. (i) Suppose, in the situation of Lemma 3.7, that 
a¢Q(V); thus a(1+d)¢€Q(V) for some de 48*u. A close a 
of the proof reveals that the reason is that 


r= |ad-+ 2E -+ Eat | = | ad | for all €F. 
It follows that r — max{| ad |, | 8a |}. 

(ii) A fact which will be used in conjunction with Lemma 3.7 is the 
following: if 8o ==4ọ (ie. dV =— A), then Q(V) consists either of all 
elements of even order, or of all elements of odd order. For a proof, see 
. 63:15, [4]. Trivially if $0 (i.e. Vo FH), then Q(V) =F. 

(ii) Let a540 and K = @(a, 8) be given, with a-~a. By multiplying 
a by a suitable square unit if necessary (and 8 by the inverse of that unit), 
we can suppose that a = ra + c where d(m**a? + ac) ==aco. One can show 
that FK4= FK, (eg. Q(FK4) =Q(FK) by 63:11a, [4]), so that it is 
even possible to assume that c= 0 if c€ 4ap*, since Kê = K by equality of 
norm groups. 

Lumma 3.9. Let L be a ternary unimodular lattice. Then 

L = Q (b, 408) 1 <a> 
where a is a suitable norm generator of gL, and b is an arbitrary base 
generator, and o—=0 or p, (p is as usual the unit gwen by A = 1— 4p). 

Proof. See 93:18, [4]. 


Definition. A lattice is almost a-modular if it has a Jordan splitting 
1. <a> where K is a-modular and ao—a. A unary (1 dimensional) almost 
a-modular lattice is a unary ra-modular lattice. 
' Before deriving the canonical forms for almost modular lattices, we tran- 
scribe the following useful result from 82:15 in [4]. 


Lemma 3.10. If L is a lattice containing the a-modular lattice J, then 
J splits L if and only if B(J,L) Ca. 


Lemma 3.11. Let L be an almost unimodular lattice. 
(i) If dimL=2, then Lœ <a 1 <b> where a€u, DE m. 


3 
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(ii) If dimL—3, then L=((b,4ub") L<a) where ab, w==0 
or p, [b | 2 | 2r|, and o—0 if |b| =| 2r]. 
(iii) If dim L=4, then L=H1<a> 1 <b> where acu, bE wu. 


It follows that gL—o unless dimL—=3 and |a|>|b|; in this case 
qL=—=ao?-+ bo. Moreover in (ii) if be bu, then L= Q (bı, 40b,7) 1 <a>; ` 
also w==0 if and only if FL is isotropic. 


Proof. (i) is trivial. Consider (ii). We have L= @(a,8) 1 <er> 
where e is a unit. Suppose a~. Choose £€ o such that &ex==— a mod ap. 
Then by Lemma 3.10 and the invariant properties of the Jordan form, 
Lex Q (a Sen, B) 1 <¢x> for some unit d. We write Q (a + £er, 8) in the 
form (æ, p), and if either a or f’ ~-z, we repeat the same process. By 
the results on canonical forms for binary lattices, this process eventually leads 
to the form given in (ii). 

Now suppose that Z is given in the form (ii), and define K = (bi, 4ubı") 
L<ay, where 6,€ bu. Clearly FK=FL. By 3.8, we can assume that 
d,—b-+y where yob. If y=0, K= L, otherwise y~a and there is an 
integer n such that n?-+y==Omodyp. As above, the lattice 


J = A (b, + 77a, 40b;*) 


splits K, and dJ =— 1 + 4o by the Local Square Theorem. Therefore FJ 
= FA (b,,40b,*) and a calculation of discriminants shows that K = J 1 <a>. 
Moreover bı +a = (b+ 7’) where deu and |yY|<|y|, whence J 
= (1(bs,40b,7) with ba==b -4+ y. It is now clear that after a sufficient 
number of applications of this technique, we can put K in the same form 
as that in which L was given, and so K =L. This proves the first half of 
the last statement of the lemma, and the other half is obvious, 

Finally case (iti). We can write L= @(4,8)1<e1<er> where e 
and € are units. Then we can “reduce” a and 8 by using e and e'r as in 
the first part, and thus ultimately achieve the required form. 


Lemma 3.12. Let L be unimodular of dimension 2n, with gL == ao? + bo, 
nL D 20. Then dL = (—1)*modabo—that is to say, there is a determina- 
tion d of dL such that d= (— 1)” mod abo. 


Proof. Since L is the orthogonal sum of binary unimođular lattices, it 
suffices to prove the lemma for dim L—2. But this case follows immediately 
from the canonical form L = @ (a,,8a,"t) since nL D 20 implies that 8a, € bo. 
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Lemma 3.13. Let L be a quaternary unimodular lattice with gL = ao? 
+ bo. Then 
Le g (c, 4pc+) 1 6(a,b’) if b¢ 2p 


where c is either a suitable norm generator of gL, e. g., —a + b, or an arbitrary 
base generator. Also 


Le ((c,0) 1 @(a,6’) tf BE 2p 
where c ts any element of gL. 


Proof. First suppose that b€ 2p. Then the result follows by applica- 
tion of 93:18, [4], and Lemma 3.4. Suppose b¢ 2p; we shall prove this 
case along with the following lemma (the converse of Lemma 3.12 when 
dim L == 4). : 


Lemma 3.14. Let g—ao*-+boCo bea norm group with b¢ 2p. Let 
F be a quaternary space with d(dV) Cabo, where dV is a unit. Then there 
is a quaternary unimodular lattice K on V such that gK =g. 


Proof. Let b be any integer such that 1—ab’€ A-dV-u?, d(1—.ab’) 
==ab’o. By field theory F£(a,b’)—YV. Write 


V = <a> L<— aA LFE (a,b) 
If a~ a, set c= — a +- b; if a~ b, set c=b. Then 
K = B (c, 4pc") 1 8 (a,b') 


has the required properties, since b(dK) C abo implies 0’€ bo. And Lemma 
8.13 is also proved since K = L by equality of norm groups. 

We now wish to extend the results of the last lemma to include all ternary 
and quaternary unimodular or almost unimodular lattices. These results 
are of fundamental importance for the theorems on representation which 
follow, and the fact that no such general conditions for the existence of binary 
lattices with prescribed norm group are possible, leads to considerable difficulty 
later on. The trouble arises because the discriminant and the norm group 
are too closely related in a binary lattice. 


LEMMA 3.15. The quaternary space V supports an almost unimodular 
lattice with norm group g if and only if g=0, dV ~r. 


Proof. The necessity follows by Lemma 3.11. Assume that dV is a 
prime element. By field theory F#—YV, so that Vase PH L< 1 <—ed VD 
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for some unit e. The lattice Lox 4 L <e L <—edV) fulfills the requirements 
of the lemma. 


Lemma 3.16. Let V be a ternary space and g == ao? +- bo a norm group 
admissible as the norm group of a unimodular or almost unimodular lattice: 
20C qgCo. We further assume that dV has been expressed as a unit or a 
prime. Then there exists a unimodular (resp. almost unimodular) lattice L 
on V with gL—g if and only if (i) dVe gL (ii) BE 2psS V is isotropic, 
and finally (iti) dV —1 (resp. dV ~r). 


Proof. The necessity is easy to prove by consideration of canonical 
forms. To prove the sufficiency, we first note that — dV € Q(V) is equivalent 
to F39{- V. In this case, the lattice L= đ(c,0) |<—dV) satisfies the 
requirements, where c = b unless dV ~ and g= o, in which case c=a. If 
-——dV¢Q(V), then V is anisotropic and therefore b¢ 2p. By field theory 
<—A:dV>->Y, therefore by 3.8, V = <c> L¢—Acd>1<—A-dV)> where 
c is defined above. The lattice L= @(c,4pc*) | <—A-dV)> on V has the 
required norm group. , 


Lemma 3.17. Let L be a unimodular or almost unimodular lattice of 
` dimension at least 5. Then Lo 31K for some lattice K. 


Proof. If L is unimodular; this is proved in 93:18 of [4]. If L is 
almost unimodular of even dimension, the lemma follows from Lemma 3.11, 
(ii); if it is of odd dimension, an argument similar to that of the latter 
lemma yields the result without difficulty. 


Lemma 3.18. If HiL&=AIK, then L&K. 
Proof. See 93:14 of [4]. 


Lemma 3.19. Two dlmost a-modular lattices L and K are isometric 
tf and only tf FL=FK, and gh —=gK if their dimension is odd. 

Proof. The necessity is obvious. We can assume that a—o and that 
FL== FR. If Le: #11 and K = | K’, then gI’ = gk’ = gL, FU = FR’ 
and it suffices to prove L’ =K”. Therefore by Lemmas 3.17 and 3.11, we 
may assume that dim L==2 or 3. In the former case, 


L= {z€ FL | Q(z) € 0} 


by the principle of domination so that KG L since Q (K) Co. Similarly 
LCE and so L=K. 


Suppose dim L==3. By Lemma 3.11, L=((b,4ub) L<ay and 
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K = A (b, 40’b-1) | <a’y, (the same “b” is used in both expressions since 
gL-=gK implies their base generators are equal in value). But o=u 
since w==0 <=> FL (=FE) is isotropic &> o’ == 0. "By ‘discriminants 
<a> s <a’) and so LK as required. 


4, Canonically derived lattices. In this section, L will be a lattice 
with the Jordan form L= L1: LL We shall derive three classes of 
lattices from L in a canonical manner. f f 


4.1. The dual L*. This lattice is defined as 
L* == {x€ FL | B(z, L) Co}. 


Most of the statements about duals which follow are easy to prove, but in 
any case proofs can be found in §82F and §82G of [4]. First (J LK)* 
=J* | K* shows that L*—=L,*1---1L,#. But the dual of an a-modular 
lattice M is given by M*=—= qM. Thus L* is a lattice on FL, Ki 1: --1 Ky 
is a Jordan splitting of L* where Kk=L;,.* and 8Ky=—= (81441). It is 
also easy to see that (Lf)*—L, and that ZF—L if and only if L is 
unimodular. The most useful fact about duals is the following: 


Prıncıpte or Duaurry. If land L are two lattices of the same dimen- 
sion, then l>L if and only if LI, : 
For suppose that IC L; then it follows directly from the definition 
that LE C 1#, whence L*¥->1*, Conversely, if L#—> 1*, then (IF)#— (L*)#; 
ie, l> ZL: l i 


4.2. . The lattice L^. Here a is an ideal, and we define 
Es = {re L| B(s, L) Ca}. 


(cf. 8821, [4]). It is obviously a sublattice of L, and is equal to L if and 
only if 8LCa; if a40, FL = FL. Since (JLK)= JLK", we have 
L= Ltl- -LL And if M is a b-modular, then Me—=M if bCa, 
Me = ab"M if aCh. 


4.8. The lattice La. Here a is a.non-zero ideal, and we define La to be 
the lattice whose dual is generated by the set of vectors - - . 


{zE L* | Q(x) €a}- 


Thus Lof CL*, and so LCL, since clearly FLa= FL. Also Ig—=L if. 
nL* Ca, although the converse does not hold in general; e. 8, La=L for 
any a if L=&. IJ is any sublattice of L* with nJ Ca, then J C Laf; 
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thus Laf is the smallest lattice containing all sublattices of L* with norm in a. 
This also shows that if dim l= dim L and nL* Ca, then I>L if and only 
if a> LD. Indeed L*>1# if and only if L#>1,¥. 

In order to use this latter fact effectively, we must be able to determine 
la from l, say from a Jordan splitting of I. Suppose that L=JLK and 
nJ*Ca. Then by the principle of domination, it is easy to see that 
La=J LKa Thus the problem of determining La is reduced to that of 
finding Ka. This is quite easy to do in the cases of importance to us, 
namely dim K==1 or 2. We shall now give formulas for calculating Kg in 
these cases. The formulas are easily proved, usually by means of the principle 
of domination. To simplify the notation, we shall assume that 8K =o, and 
we let r(a) be the smallest non-negative rational integer such that ap Ca, 
for any non-zero g€ F. 

First suppose that K is unary: K = <a>. Then Kaf = <ar®y. 

Next suppose that K = @(a,B). If 80, then Kaf = gilar’, Br), 
where t=r(a%) +7r(8). If 8—0, then the same formula holds for K,* 
unless amt(® € 2p, In this case, let s be the smallest non-negative integer 
such that ap?! C 2p; then Kat = Y, 

Finally suppose that K* == <a L <B>. If aß, then 

Kaf = Laroy | Lpr" O. 


If a~ and BEaN ao, then the same formula holds. Suppose that «~ 8 
and aC foCao. Define s by |ar| =]|8], and put J# = (am) 1 <B>. 
Then Kaf œ= Ja* and Jaf can be calculated by the formulas of the preceding 
paragraph since it is modular. 

The restriction of the above calculations to the unimodular case is justified 
by the following formulas, as are other similar assumptions in the rest of 
the paper. Let «€ F be non-zero. Then 


(L*) a? = a! (Lan) *, (L*)q == Lan 
The last formula can also be written La = (L*)a-u. 


Lemma 4.4. If Lisa binary modular lattice, then La is modular. 
Proof. We can assume L is unimodular. If La is not modular, then 
neither is La*, and so 
LD Ip* = 07 1 oy 


= <a> L <B> 


with |a|>|B|,a~ 8. Since Q(a*y) € a, y is a maximal vector of L and 
therefore L == oy + oz where B(y,z) —1. It is easily seen that z € o(y— Bz) 
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so that | Q (x)| =| Q(y—Az)| = |£ |; a contradiction. Thus La is modular 
as required. 


Lumma 4.5. If L is binary modular, then nLa* Ca or Lat = &, for 
some 4. 


Proof. We can assume that L is unimodular. If a C nLaf, then we 
can find t’, in Lf = L such that nu f= Q(X z;)o, (in particular 
E nE Laž), and such that Q (21),* © -,Q(24)€a. Thus it is clear that for 
two of the zfs, say z, and Ta we have nLaf C 2pt where B(z,,2.)0 = pt. 
Since Q(z,) and Q(z,) are in a C 2pt, the Local Square Theorem shows that 
dK = — rt where K = 02, + 0%. Since nK = 2p, we actually have K = i. 
Now 8K D 4nLq* D 8La* so that Laž = K since it is obvious that K C La*. 
Therefore Laf = Sf, as required. 


5. Existence of certain sublattices. The first result, Theorem 5.1, is 
important for two reasons. First, it is used to prove Lemma 5.2, which in 
turn is used constantly throughout the rest of the paper to construct lattices 
with given norm groups. Secondly, it shows the manner in which any sub- 
lattice 2 of a given lattice L is imbedded in L. For example, suppose that L 
is unimodular, and that ==}, L- -+L is a Jordan splitting. Then there 
is an (almost) modular lattice L, C L with scale 8), such that L == l, LL; 
again there is an (almost) modular lattice L CL,’ with scale 81, such that 
La =l, LL. This process can be continued until the lattice 2 is ultimately 
constructed. 


THEOREM 5.1. Suppose that the lattice I is represented by another 
lattice L. Let a be an ideal contained in (SL). Suppose l=1, Ll, where 
sr Ca, 8, Ca and dimh < dim L. Then there exists an a-modular or 
almost a-modular lattice k such that la— k, LLk>L, dim (l Lk) == dim L. 


Remarks. It is possible that J, or l==0. The condition aC (8L*)+ 
means that a is contained in the scales of all Jordan components of L, while 
8l,* C a™ has a similar meaning for I, if L540. 


Proof. We can assume that+C L. If dimi < dim L, say FL= FIV, 
choose an orthogonal basis for V and let V be the lattice spanned by them. 
For suitably large m, pr” CL and 8(p™l’) Ca. It is clear that adjoining 
pl’ to I allows us to assume that dim l= dim L. In particular 1,540. 


Suppose that l, is not (almost) a-modular. Then there is a maximal 
vector z&l, such that B(z,h) Ca and Q(x) € ap, (consider a Jordan 
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splitting of l). If z is not a maximal vector in L, then m*sE L and we set 
J = o (rz) +l Then 


8J == B (J, J) =Q (2) 0 + B (rz, le) +8, Ca. 


Now suppose that z is a maximal vector in L. By considering any orthogonal 
splitting of L into unary and binary modular lattices, we see that there is a 
vector y in L such that . 

B(z,y)o =B(y; L) =a. 


Let Y =Y -+ Y: where y€ Fl, and y,€ Fh. Then 
B (Yx l) = Bly, h) (en B(y, L) =f, 


whence y: € h C L, and therefore y€ L. Also B(x, y1)0 == B (z, y)o =a, 80 
that Y: £ la (since B(z, h) Ca). Moreover if J — oy, +- ls, then 8J Ca by 
an argument like the one above—note that ỌQ(y:)=Q(4)—Q(yı) and 
Q (y) Ea. 

Using the original vector z, we have found a lattice J D l; with 8J Ca. 
Thus letting dim l, == m, we have bl; bJ Ca”, If J is not (almost) a 
modular, we repeat the process. Continuing in this manner, we get a dhain 
of lattices on Fl, with volume at most a™: 


LeIere- “Sh 
bh Co CoC. + Cam, 


Since the volumes are bounded by a”, the chain must break off after a finite 
number of steps, i.e., we eventually get the desired lattice k. 


Lemma 5.2. Suppose l and L are lattices such that dimi < dim L, 
Fl FL and gl gL. Let a be an ideal such that 81* and 8L* are contained 
in at. Then there is an a-modular or almost comodilar lattice k such that 
E(ILk) = FL and gk C gL. 


Proof. Let 8l—=ps, If V œ <a> is a unary component of 1, it is clear . 
that V> Q, (a, 0) =I; it V= ,(a,8) is a binary component of 1, then 
w —>d,(&0)1(Q,(8,0)=L”. Clearly gZ’ and gL” are both in gL. Thus 
expressing } as an orthogonal sum of unary and binary modular lattices, we 
can find a p°-modular lattice M such that l> LLM, gM C gL, and such that 
FM is a hyperbolic space, i.e., an orthogonal sum of spaces isometric to FO. 
Now apply Theorem 5.1 to find an (almost) a-modular lattice K such that 
gK CgL and F(ILK)=F(LLM). By Lemma 3.17, K= K’ 1M’ where 
dim K’ = 4 and FM’ is zero or a hyperbolic space. 
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By removing an equal number of hyperbolic planes FY from FM and 
FM’ and applying Witt’s Theorem, we can assume that either M or M’ is zero. 
If M=0, then we can choose k=K. Suppose M40, M’=-0, so that 
dim K <4. Since dim? < dim L, we must have FM = FH. Now FL = FILV 
for some space V, whence 


FILVYLFX=FILFK; 


therefore FK is isotropic. Choose a maximal isotropie vector z in K and 
another vector y in K such that B(z,y)o=a; this is clearly possible if K 
is modular; if K is almost modular their existence follows immediately from 
the canonical forms of Lemma 3.11. Then by Lemma 3.10, K = (oT + oy) Lk, 
and k is the required lattice. 


Lemma 5.3. If L is a masimal lattice, then I>L if nlCul and 
FI>EL. 


Proof. Assume FIC FL. Let M be a nL-maximal lattice on FL con- 
taining I (cf. §2). Then i>M=L by Hichler’s Theorem, as required. 

The last lemma can sometimes be used in conjunction with the next to 
test for representation. 


Lemma 5.4. A lattice L contains an a-mazimal lattice (on FL) if 
aC 4(nb¥)-3, 


Proof. We shall prove the lemma for a==-4(nL*)-+; the more general 
case follows from this by Lemma 5.3 and the fact that a given space supports 
a b-maximal lattice for every b. Let M be a (nZ*)-maximal lattice con- 
taining L*. Then 8M C 4nM = $nL* and so 


== 2 (nL*) M C (8M)"MCHFCL. 
W is clearly the required lattice. 
COROLLARY 5.5. A modular lattice L with nl —28L is nL-mazimal. 


In particular H, and Bi(?m', prt) are 2pt-maximal. 


6. Representation when the dimensions are equal. In this section 
we shall give conditions under which } is represented by a unimodular lattice 
L of the same dimension. 


Lemma 6.1. Let L be a ternary unimodular (resp. almost unimodular) 
lattice and I be a ternary almost p-modular (resp. pomadalar) lattice. Then 
I> L if Fle: FL and m'gLC gG gh. 
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Proof. Put the two lattices in the canonical forms of Lemma 3.9 and 
3.11: 
L= (b, 4ub) L<ay, læ Q(B, 4m) 1 Cap. 


Now o =w’ since otherwise one of FL and Fl would be isotropic and the 
other not. Thus by discriminants and the fact that gl C gL, we have «€ ao“. 
Since a~a, we must have 8-~b and therefore SE bo. Since 8 can be 
“replaced by any element of the same value (by 3.9 or 3.11), we can assume 
ß—#*b. But since 7*gi C gl, k—0 or 1 and the reader can easily check 
that Q, (8, 408-12?) > A (b, 40b-*) in either of these cases. Since <a>— <a> 
by what was said above, 1 L as required. 


Lemma 6.2. Let 1 and L be almost modular lattices of the same even 
dimension. Then I>L tf 81C8L and Fl FL: 


Proof. By Lemmas 3.17 and 3.11, L= LE, l= Lk where I’ 
and I’ are zero or modular hyperbolic lattices of the same dimension (a hyper- 
bolic lattice is the orthogonal sum of 57s), and K and k are binary almost 
modular lattices. Clearly 7—>L/. By Witts Theorem FE=FK. By the 
principle of domination K is maximal. Therefore k—>K by Lemma 5.3 
since nk == 81 C 8L = nK. 


_ emma 6.3. Let g bea norm group contained in another norm group g'. 
Then g is a proper subgroup of g if and only if either some norm generator 
of g or every base generator of g is in tg. 


The proof is straightforward and is omitted. 


Lemma 6.4. Suppose L is unimodular, l is p-modular and dim L 
esdimle=4. Then loL tf Fl=&FL and wigh CglC gL. 


Proof. Tf nL==2o, then > L by Corollary 5.5 and Lemma 5.3. We 
can therefore assume that nL 020. We put gi—ao*-+ bo. Note that no 
norm or base generator of gl can be in w‘gZ since otherwise it would be in 
a’gl which is impossible by Lemma 6.3. It is clear that there are three cases 
to be considered: n? equal to nL, mnb or an. 


First Case: nl==nL. A suitable choice of a is a norm generator of gl 
and either b or w?b is a base generator for gi. By Lemma 3.18, 


Le @(¢,40c) | (a, b’) 


where c=b or —a-+b, w==0 if b€ 2p, otherwise w==p. If b is a base 
generator of gl, (i.e., gd-=—gZ), it is clear that 
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L <- B, (c, 400r?) | 61(8, 67?) =l; 


the isometry results from the equality of norm groups, and O’Meara’s theorem 
on the isometry of modular lattices. Similarly if »°b is a base generator of 
gl, then 





L < Q (nc, 4ve+) L 81 (a, br) =], 


unless op and |b|<|c|—~|2| since in this situation, 4oc*¢ gl. How-, 
ever|we can then apply Lemma 3.13 to !: 


1 = Q, (27°, 0) L (a, B) 
—> É (2,0) L (a, Br”) =L 


by equality of norm groups. Note that Sx ?¢ gL since BE 2p*. 

Second Case: nl==anbl. It is easily seen that gl== bo? -+ m'ao =n], 
gLeenL. Let zı, Ta, Zs, 2, be a basis for L corresponding to the canonical 
form in the previous case. Suppose that c--—-a-+-b. Then the lattice 


J = 0 (21 +2) + oza = A (b, dwc) 


splits L_by Lemma 3.10: L=JLK; moreover nK =n since nJ Cal. 
Therefore for some norm generator a’ of gL and for either possibility for c 
(i.p, —a-+ or b), we have 


L == Q (b, 4we*) L E (a, b”) 
< Qi (b, toer?) L Q, (a73, b”) = 1; 


the assumption that nL D 20 ensures that b” & a'p = gl. 


Third Case: nl==n°nL. Define k— (1*)" and K = (L*)"; k is uni- 
modular and K is p-modular. An easy computation shows that gK <«gL 
and gk==a gl. Therefore nK == nk and the given norm group condition is 
equivalent to a*gk C gK C gk. Applying the results of the First Case, we 
get K — k, i.e (L*)*— (1#)” whence Lf — 1* and finally l— L as required. 


Definition 6.5. A splitting =h i: --Lh is called a quasi-Jordan 
litting of l if h,’ © +, ha are modular, and l; is modular or almost modular, 

8, D 8h D- -D 8h, and with the additional proviso that if dim l; == 1, then 

l| is modular and moreover 8l; C m8h if t>1. 

Any lattice 7 has a quasi-Jordan splitting—it can be derived directly 

from a Jordan splitting. And it is clear that ¢, dim l and 8h, (1Sı=t), 

are the same for every quasi-Jordan splitting of I. l 

The conditions 8: C 8L, gl C gL, and FI>FL are obvious necessary 
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conditions for 1—> D. If diml= dim L, then L*—/* yields the additional 
necessary condition gL* C gl*; if L is unimodular or almost unimodular, 
then LC L* and so gi C gif is also necessary. This condition is usually 
not quite strong enough, and it is often strengthened, as in the next theorem, 
by using one of the derived lattices la introduced in 4.3. 


Touorem 6.6. Let L be unimodular or almost unimodular, and let I 
‘be another lattice of the same dimension. Put 8— (81,)-" and suppose that 
dim 1, = 8, where I, ts the last component in a quast-Jordan splitting of |. 
Then I>L if and only if Fle FL, 81C8L, and gi C gL C glaf. 


Remark. If l, is p-modular, then laž = l** 3 (mih) =1*. If h is 
almost modular, the principle of domination shows that Ig == 1;** L(m*l,) C IR, 


Proof. If I>L, then L>1#. Since nL C8, it follows from 4.3 that 
L->1,#, The necessity is now obvious. 

Now let us consider the sufficiency. The proof is by induction on 
r(l) ord(8l,) 20. I 7(1)=0, then 7? and L are both unimodular or 
almost unimodular with equal norm groups (since lf ==1), and so l= L. 
Hence we may assume that i=r(l) > 0. We may also assume that nE D 20 
since otherwise I>L by 5.5 and 5.3. 

Now suppose that diml,>4. By Lemma 3.17, el’ LY, and 
Le 1 3. Clearly 1,’ is the last component in a quasi-Jordan splitting of 
Vee l* 11/7, and 81/—81, Also gl= gl, gI’ = gL, gt =gl*, and FY 
= FL’ by Witts Theorem. Since it is clear that Ze V1 Y; > LSL LH 
if VI, it suffices to show that ’>L’. This allows us to assume that 
dim lh; == 3 or 4. 

Put t= 8h and gl == ao? +- Bo. By 93:13 of [4], 


11:1 =i1lı(a,0) 1 G,(B, 0). 


By Lemma 3.17, 
41040) 1 s(8,0) seh 1 HL Hy | 


for some (almost) t-modular lattice 4’; it is clear that gi,’ == gt and Fl’ = Fh. 
Using Lemma 3.18, we get 1 = 1,* 1 1’—that is to say, there is a quasi-Jordan 
splitting in which the norm group of the last component is equal to glt. Let 
us assume that the splitting l= l L’ - -141, already has this property. Since 
It ntt, this means that glg* == *+gl;. 

Now define a norm group g=gl N pt'maw?gl. We shall find an 
(almost) p**-modular lattice k on Fl; with gk =g. Suppose for the moment 
that this has been done. Then we have 1, >k by 6.1, 6.2 or 6.4—the con- 
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dition in Lemma 6.1 or 6.4 involving norm groups becomes gl; C gk Ca *ghk 
in this situation—and r(J) <r(l) where J==1;* 1k. Clearly gJ Col. 
Also gL C gJg-¥ where 8’ = (8k) since 7 


gyt D g(a GDh) eae 2D gh (RL) NEN migle 
D gh Na gl = gL N glaf = gL 


Therefore J > L by induction, whence 1—> J —> L. The theorem will therefore, 
be proved as soon as we show the existence of k. 

By Lemma 5.2, there is an (almost) p*1-modular lattice K on Fl, with 
gK C gL, unless L is almost unimodular and i==-1. But such a lattice K 
also exists in this last case. To show this, first notice that we can find a 
unimodular lattice M on a hyperbolic space of dimension 2n == 2 dim1,* 
th pe 1,*—> M and gM C gb by the same technique used at the beginning 

e 





of proof of Lemma 5.2 (we may suppose that l;* 340 since otherwise we 
can take K = L). Thus k*—> LLM andso LLM =1,*1K’ by Lemma 3.10. 
Now dim K’=8-+-dim M, whence K’ is split by a unimodular lattice M’ 
consisting of an orthogonal sum of hyperbolic planes with dim W’ = dim M, 
by Lemma 3.17%. Define K by K’= KLM’. Then gK Cgk’Cg(L1M) 
= gL and FK = Fl, by Witts Theorem. Thus K is the required lattice. 
First Case: diml,==4 and |, is modular. First suppose that I; is p- 
modular ((—1, t=1 or 2), and that b€ 2p where gL ==a0°-+bo. Then 
K 2 %1 E’ where K’ is binary unimodular, by the second part of Lemma 
3.18. U ni == 2p = gh, then h HLY, or HL g(r, pr) since any 
base generator of gl, is in 2p*. In the first possibility k = 41% has the 
required properties. The second possibility is ruled out by the existence of 
K } namely FE’ = F 8, (2r, 2pr), and from this and 3.8(ii), it is clear that 
ri cannot support a unimodular lattice whose norm group is in gl. Now 
suppose that nl; D 2p. Since K’ is unimodular and gk’ C gL, it is clear that 
2rlis a base generator for gK’ as well as for gL. Applying 3.8 (iii) and 3.4 
to| K’, we get K’ s: @(n*™a,8)—if nK’==20, this follows directly from 
3. 8 (ii) and equality of norm groups. There is a lattice on FK’ with matrix 
6 (a, Pr), and its norm group is clearly in gL; we may therefore suppose 
that m0, i.e. K’ = @(a,8) for suitable 8. Now gi gE and nD 2p 
implies that nl;~a, whence 2r is a base generator of gl, whence there is a 
norm generator of gl; of the form 7*a for some n>0. We say that 


l = . Ha 1 Bs (ma, Ba-2n*2), 


Since Fl, = FK, it is clear that we need only show that fa ****€ gl, since 
then the two norm groups will be equal. To this end we notice that Fl, = FK 
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is isotropic, and we may therefore split a binary isotropic lattice h off l; 
if h* is the orthogonal complement of A in l, then A* is a binary p-modular 
lattice on FE’ with gh* C gl, A comparison of a canonical form of h* and 
Bi (x?"a, 87?) shows that Ba"? E gl, as required. Now an easy calcu- 
lation shows that l 
ao? +- 2ro if n==0, 
13 Ba. if n> 0, 


and therefore that a proper choice of & is 


p= pe ee if n—0, 
~~ | HLB 2a, Br?) if n> 0; 


the reader can easily check that 8 or Br***? as the case may be, is in g. 

From now on (in the First Case), we may suppose that either += 2, 
or that i 1 and |b | = | 2|; this implies that 8, € 2pt, where g == a0? + £00, 
(directly from the definition of g). Thus writing d¥l,c:1—-8 where 
d(1—8) ==$0, we see by Lemma 3.14 that k exists if 


(1) 8 E apop. 


Let us write gh == a0? -+ Bo. If gl; C g, then Lemma 6.3 shows that (1) is 
satisfied since i 
F SE aBp*t +40 


in any case. Assume that g—gl; Then we must have |8|==]|b] and 
|al=]|a| or ||. Therefore g=gLNp*t, and so gK Cg, and (1) 
results from the similar expression for gK. 


Second Case: dim l = 4 and l; is almost modular. It is easily seen that 
k= K satisfies the requirements. 


Third Case: dim l =3. If l = €i(B, tofrt) 1 <a>, (o=0 or p), is 
the canonical form for l; and if l; is modular, we set 


= | Qia (Br, opr) | <a> if Parte gL, 
(Aes (Butt) 1 Cay it Brg gL. 


The reader can easily check that this is a proper choice of k; the only difficulty 
that arises is the case where |ß|—|2r* |, Br*¢ gL. But then the existence 
of K shows that w=-0, and the choice of k is legitimate. If I, is almost 
modular, (so that « is not necessarily a norm generator of gl), the considera- 
tions are very similar to those of the modular case and are omitted; we merely 
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point but that the existence of K shows that am*€ gL. This finishes the 
proof of Theorem 6.6. f 





Torn 6.7. Let L be unimodular, and | another lattice with dimi 
—dimL>3 and dimh =? where l; is the last component in a Jordan 
it Text lL. Suppose further that nL nlm, where 
gl... Then I>L if and only if Fl = FL, 81 C8L, and gl C gL C glm. . 


Proof. The necessity is obvious (note that lL implies L> Im* by 
4.3).| Therefore suppose that FI = FL, 81C8L, gl C gl Cglm*. Take a 
Jordan splitting 1—=1,1---11, and let gL = ao? 4+ bo. We can suppose 
that L D 20 since otherwise I> L by 5.5 and 5.3. 


First Case: n®—=nlf. Then by definition of lm, Im*==1*. Suppose 
that nl.*® C nl#—nl¥8, Then 1# —=l,,* 1 K for some lattice X with 
nK = nl#? (cf. 4.2); 1..* is the first component in a Jordan splitting of 
18, |A direct application of Lemma 3.10 shows that another Jordan splitting 
can be chosen for 1*8 in which the first component k has nk=nl*®, Since 
kag, it splits 1* and it is clear that it can be chosen as the second 
component in a Jordan splitting of If, Therefore we may assume that 
l= L'- LI has the property that nl == nlf = nl¥. 

Choose cE Q(4*f) with nlf ==co and write 4#= 64(a,8). Suppose 
that |a~c; then we can “reduce” a, using c, by the same method as in 
a. 8.11 (i.e., using the perfectness of the residue class field along with 
Lemma 3.10). A similar thing could be done if 8—c. Let k be the lattice 
derived from l;* by one application of this technique. It is easily seen that 
nk* = nl* (where 1* == ķ* 1%), and therefore the reduction method can be 
applied again to k if necessary. It is clear that a sufficient number of applica- 
tions of this method will yield a lattice of the form Qa (y, doy'r*), o = 0 
or p; where le|>|y| =| “ey*r* |, cy. Let us assume that l;* is already 
in this form. 

Since gi C gL, it is evident that rye gL. If #R,egZ, we put 


T L Bes (aty, dary) 5 


clearly lo J, g? CgL CgJ¥—=gl*, If mity g gL, it is easly to see that «74, 
is a base generator of gL. Then the existence of a p**-modular lattice on Fl, 
with norm group in gL (Lemma 5.2) shows that | *4y| > | 4wy> |; in this 
casd define . 

J = h* 1 Qu (ay, oy tr); 


again, I>J, gJ Col. Clearly b€ yp*CgJ*. Now gl** contains an 
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element with value |a| since c~a and nL Cnlf—nl**; we can suppose 
that it is of the form a- d with D(a? -} ad) ado. Then x°! (a+ d) € gh, 
where 81,, = pf, so that de bo —yp**; therefore dE yp? and so ac gJ*. 
Thus again gE C gJ*. 

By induction (on i—j), we get a lattice X on Fl such that 1K, 
aK CoL Cgok*, 8K C80, and which has a Jordan form K == K,1-+-1 Kia 
. with dim K,.>3. Therefore K > L by Theorem 6.6, and so l— L as required. 


Second Case: nl* C nl*. Then for every Jordan splitting l == l, L: ++ Lt, 
nl* = nl,*; by the same method used in the First Case, we can choose the 
Jordan splitting so that nlf = nl*8. 


1). Loe Sy. If nlt ~b, choose y so that yo==anl,.*. If nli.#), 
let y be an element of maximal value in 2p N bp?! N p-J (where 81,_, == p/) 
such that y—b. Then straightforward calculations show that 1,* = Gi(y, ) 
and I>1* L G,(yx*4,0) >Z (using Theorem 6.6). 


2). ke Bi(a,B) AH, Prg gl. Then it is easy to see that £ is a 
base generator of gL == a0? + bo. By Lemma 5.2, there is a p/-modular lattice 
P = i(n, 8’) on Fl, such that gP C gL. By replacing o by on™ and 
B by f’n-** if necessary, we may suppose that | a’|—|a| and | ~’|—| A |. 
But it is easy to see that gl; —¢6i(o’, 6’), (express « and a’ as elements of 
to? + bo), and therefore h = (g, 8’) > P. Since £ is a base generator of 
gL and since gP’C gL, there is a norm generator for gP of the form a. 
Since nP* = nl* D nZ, it follows that gl gP*. Therefore 1->1,* LP>L 
by Theorem 6. 6. . 


3). he laß) HH, Bree gL. If we let E = l* 1 Qu (a, Br*), 
then gK C gL and t-> K. Since J; is not a hyperbolic plane, the principle of 
domination shows that MFC K*. But [#8 C K# so that nif C nk ==’, 
whence In? C Km*. Therefore gL C gKw*. The proof of 3) now follows by 
induction on 1—j. Indeed if i—j—1, then l—> K — L by Theorem 6.6. 
Suppose t—j>1. If nK®—nKf#, then 1>K—-L by the First Case of 
this theorem. If k= Qi (a, Br?) = Y, then 1>K-— LD by 1), or else 
we have ks 6,,(a', 8’) AA. If Bm? gL, then 1+ K > L by 2), while 
if pw? € gL, L—> K —> L by the induction hypothesis. 


Lemma 6.8. Suppose that K=J16(a,8), K=J 1 @(a, p’), where 
gI = gd’, nI C nK = a0, nJ’ C nK’ = g'o — o, and |B|=|p’|. Let a be 
a norm generator of gK. Then gE’=gK if 5(ae’) C b (aa). 


Proof. We can assume that a = a -+ y with b (aa) == ayo, and! = a + y’ 
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with (ax) =ay’o; thus |Y|=|y|. Since it is clear that gK’—gK if 
y€ b= 20 + Bo, we can suppose that yé b. l 

Since a€ gK, we have a= c+ e&(a-+y)-+b’ where b’Eb, ce gJ, and 
e€u since nJ C nK. Write c= éa -+y with db(&a -+ an) = aqo. Then 


a? = (e + £)*a? + eya + ya mod ab 


and a comparison of the quadratic defects of both sides of this congruencé 
shows that |y|=]|n]. Now if y €b, acg (a+ y,p); suppose that Ye b, 
so that Y—yra. Choose A€o such that |Am-+y|<|y]|. Then 
Ne-ta+ty€ gk’ since cegd’, and so (1+A€é)2a-+ (A'n +y) is a norm 
generator of gk’, (note that £€ p since nJ Cao). Thus there is a norm 
generator of the form a+ y” forgK’, where | y’|<|y’|: 


gk’ — (a + y")0* + fo. 


But a+ y € gk’ implies that y’ € 8”o, and therefore a€ gk’ 

Now let b be a base generator of gK. If beb, then be gK’. If b is not 
in 5 but in yo, then b€ 70 C gK’ since „= (fa-+7)—€a€ gk’ by the 
first part. If bg yo+ b, then 6 € gK implies that 


b=pa ¢+5%amod yo +b 


where 5(6?a? -+ fa) == lao, a -+¢E gJ. And much the same considerations 
as previously show that |b|—|¢|. Therefore be fo C gk’. 

We have shown thus far that the generators a and b are in gK’; there- 
fore gK C gk’. But |y|S|y|S| | implies that «€ gK, and similarly 
fe gk. Thus gk’C gk and gk’= gK as required. 


THEOREM 6.9. Let L be untmodular, and l another lattice with dimt 
= dim L Z3 and diml;—2 where |, ts the last component tn a Jordan 
splitting T=—=1,1---11;. Suppose further that ni”? C nL==m, where 
§—8l,,.*, and that a is a norm generator of gL. Then I>L if and only 
if Fle: FL, 31C 8L, glnC gl C glay + gen"? Cgln*, and whenever 
8 C8lyf, then a€ Q(Im®). 


Remarks. The condition n? C nL will not hold if dim L is odd, in 
particular if dim Z=— 38; indeed if dim L is.odd, then so is dim };*, whence 
nifs Do. In Lemma 6.10, we shall show how to tell if a€ Q(Im*). 


Proof of Necessity. If 1+, then by 4.8, ee L, whence 


Gln = gh C glm* and a€ gh = Q(L) CQ (In?) 
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—the fact that gL == Q(L) when dim L = 4 follows from elementary considera- 
tions or from the Third Main Theorem, (iii), in §7; we can use this theorem 
as a reference since it is perfectly clear from its proof that (iii) is independent 
of the present theorem. If 8ln*C38, then Im”? Inf, and so gl C glm* 
== g<a> + glm**. Suppose 8 C 8ln* = p™ ; by Lemma 4.4, lm =J LK where 
K is binary p"-modular (and J* C 1*8). 

7 Suppose first that K = Hm. By Theorem 5.1, there is an 8-modular 
lattice kf on FK such that L> J* Lk*. Since nJ* C nb, we have nk > nL; 
explicitly, k* = oz + oy = 64(a’,0) where §== p3. If nk* D nL, then by 
domination, L—> J* L (ors + ory) ; it is therefore clear that we may assume 
that |g |=]|a]. ` 

Suppose now that K 34 Im, say K*= b-m(«, B). Then by Lemma 4.5, 
it is easily seen that nlm* = nL, ie, |a|—|a|. But ae Q (lm*), and there- 
fore it is easy to see that, (by choosing another splitting J’ | K’ if necessary), 
we can assume that a =a. Again by Theorem 5.1, there is an 8-modular 
lattice &* on FK such that LoJ*1k* C lm*; it is clear that nl = nk*, 
Let us write kf = 6_,(a’,8’) where |a’|—|a|. A comparison of 6(— dK) 
and 5(— dk) shows that | g | =| «**-*/g |. 

Now combine the two cases by setting B= ~’ =0 if K = Hm We have 
gl Cg(J1Lk)* and a is a norm generator of g(J_1k)*. Moreover it is 
easy to see that 

a<a> + plat? — g(J* L B4(a, 2-418) ; 


but this latter norm group is equal to g(J Lk)* by Lemma 6. 8, and therefore 
aL C g<a> + glm’. Since the containment g<a> + gimf? C glm* is obvious, 
the proof of the necessity of Theorem 6.9 is finished. 


Proof of the Sufficiency. It suffices to prove that mL. Spitm—=JLK 
as in the proof of the necessity; thus K is a binary p”-modular lattice. 


First Case: K = Ym. Then 
8C8K*, Kt (_„(a,0), and m>M=J | Gy (240,00) >L 
by Theorem 6.6, since gl C gM# = géa> + gln”. 


Second Case: 8 C8K*, K æ Am. Since a€ Q(Im*), and nln* == nL by 
Lemma 4. 5, we can suppose that K* = @_,(a,8). Put Y =J 1 (ria, xB). 
Clearly m>P, gC gl C gay + glof’—gl’*. Therefore V->L by 
Theorem 6.6, and so 1—>L. 


Third Case: 8K* 8. We can assume that the splitting In—J LK has 
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been chosen so that J= }* for some Jordan splitting J—=1---11,; thus 
lC K. By Theorem 5.1, there is a p’-modular lattice P on FK such that 
„WCPCK. Then 


a(4* LP) C glm C gL C glm* C g (L* LP)* 


and so 1>4* LP—L. This finishes the proof of Theorem 6.9. 

The purpose of the next lemma is to enable one to determine effectively» 
whether or not the condition a€ Q(Im*) of Theorem 6.9 is fulfilled. Note 
that the defect sum in the statement of 6.10 is equal to b(aa) + d(aß) where 
gD,* = an? + Bo. 

Lemma 6.10. Let L be a lattice with a splitting L—K,1K,* with 
the following properties: K, ts binary unimodular, 8 == 8K,* C 8K,, nL? C nL, 
gL =a0? + bo C8. Then ac Q(L) tf and only tf a€ gL and, if L=- L, L L,* 
is a splitting of the above sort, then at least one of the following holds: 


aE Q(FL,), or ab¢ 20, or 4ab*€ Yd(ac), 
where the sum runs over c€ gly*. 


Proof of Necessity. Suppose a¢ Q(FL,) and ab€ 20. Write 


I, = @(a+y,B), ° 


where d(a?-+ay) = ayo is smallest for all such expressions for L,. Since 
a€ Q(L), we have 
. a= e(a ty) + 2A+AMB+ Paty 


with e€ u, AE o, éa -+ q E€ gL:*, D (Ea? + ay) = ano; note that € p. Suppose 
that B€ yp. Since y is minimal, a € Q (FL,), and Lemma 3.4, we have y ¢ 2o. 
Also 


a=(*a+y)+Pa+tn)a=((e+£)’a +ey+n)amodayp. 


A comparison of the quadratic defects of the two extreme members of this 
congruence shows that |y|= || whence 4ab € 4a8-%9 Cayo == aqo as Te- 
quired; the second containment follows by virtue of the fact that ag Q(FL,) 
implies that )(—dZ,) ~r, and Lemma 3.7. 

Suppose that 8¢ yo. By Lemma 3.7 again, we can assume that | y | 
= | 48> |. Then the principle of domination and Remark 3.8 show that 


= ((e+6)%a4+ f+ n)a mod 2atp 
with &lz|y]; ey. I abé 20, |l 2] 467] = | 4b |= | 2a]; then 
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comparing defects in the congruence leads tö | Z| =lat and the necessity 
follows as above. 


Proof of Suffictency. First let us show that L, can be chosen so that 
gl,— gL. Since a€ gL and nL C nL, L can be expressed as 


L= B(a+y,8) IR 


where y€ 20, and b(a? + ay) ayo. Iig@(a+y,B8) Cab, Bi (cf. formula 
for gi + g2 before Lemma 3.4), we can find.c€ Q(K) such that 


toy Oey) = bo. 


The lattice L, = A(a-+y,B-+6) splits L by 3.10, sna gL, =g}; write 
L, = @(a+-y, 0’). Note that we can assume nE D 2o since otherwise a € Q (L) 
easily. 

First suppose that b’ € 2p; then since y € 20, Lı = (a, b”) by Lemma 3. 4. 
Thus we can assume that b’¢ 2p, and so b (=b, say) is a base generator 
of gl. 

Next suppose that a€ Q (FL). Then clearly L, = € (a, b”). ` Theretore 
we assume that ag Q(FL;), whence y can be assumed to have value | y| 
== | 4524 | — | 40 |. 
> IE2bre3—pf, then y€ 28, and so a is a norm generator of 


L = blaty, rb) LL,*>L. 


The conditions a€ 8 and nL? C nL show that the first component L,’ in a 
Jordan splitting of L’ has dim L, = 4; using the method employed at the 
beginning of the proof of Theorem 6.6, we can find another Jordan splitting 
of L’ in which the first component K, has gK,—gl/. By the Third Main 
Theorem (ii) of §7, (which is independent of this lemma), sK: =Q (K, > 
and so ae Q(Kı) CQ(L). 

_ Finally suppose 25" 8; then ab € 20, and so we can find a -q€ gL,* 
such that 406-1 €ayo.—=5(a?-+ an). Now L,* represents éa -+ y mod 28; 
but |28| <|4b+|]<|7]|, so (by changing n to 7 of the same value, if 
necessary), we can assume that #a-+7€.Q(I,*). Choose A€ 0. such that 
| y+ y !<|y]|. The lattice J = 6(a+y-+r(@a-+n),b) splits L. It is 
easily checked, by Lemma 3.7, that J = @(a,b’). .This finishes the proof of 
Lemma 6.10. l l 


THrBoRBM 6.11. Let L be unimodular, dim L = 8, and let I be another 
lattice of the same dimension with diml;=1 where l==1,1:--Ll ts a 
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Jordan splitting of 1. Define a—=8l:.*, B= 8l af and m—nb +n” tf 
t>2. Let a be a norm generator of gL. Then necessary and sufficient 
conditions for lL are Fl = FL, 81C 8L, and: 


(i) glCgl, tf dimh.—1 and dl, dle 
(ii) gm Soh C glu’, 
(2) gL CE glay + glm”? when nlf C m ° 
(3) El) when nl® Cm and 8 C 8ln* 
if dimla—1 and dls ~ dl, | | 
(ii) gb Colt, if dimh 22. 


Proof of Necessity. (i) is trivial. So are the first condition of (ii), 
and (iii), by 4.3. So suppose that diml,,—1, dia~ dl. Since mC a, 
it is easy to see (directly from the definitions) that (la)m ==lm and that 
nila? = n/*8, Moreover the last component in a Jordan splitting of la is 
binary modular (scale 8l). The conditions (2) and (3) now follow from 
Theorem 6.9 applied to la and L, since 1 L if and only if h> L. 


Proof of Sufficiency. Consider (i) first. By Lemma 5.2, there is an 
almost 3"2-modular lattice K on F(l,,1L) with gK ==3 +C gL. But then 
Theorem 6.6 applies to hLL-- -Lha LK=M. It is easy to see that 
aM C gL C gM;* == 8 and therefore M>L. But K is §*-maximal (cf. proof 
of Lemma 6.2) whence hı Lle—>K. Therefore I>M>L as required. 

Next (iii). Put b=a if 8h 38h, b—2%a otherwise. Then 5C la 
and [5#4 == 7, so that gls Œ gL C gl)#*. Therefore > I; > L by Theorem 6.6. 

Finally (ii). As in the proof of the necessity, (la)m == Im and nla”® == nl#8, 
Since the dimension of the last component in a Jordan splitting of la is 
binary modular, one can apply either Theorem 6.7 (if nlgf8—m) or 


Theorem 6.9 (if nl m) to show. that 7D. Then I>L>L as 
required, 


. THEOREM 6.12. Let L.be a binary unimodular lattice, | another lattice 
with a€ Q(t) a norm generator of gl. Then I>L if and only if Fl— FL, 
aE Q(L), and nL C nl* if lis binary modular. 


` Proof. The necessity is obvious. Write L =g (a,c), and consider first 
the case where } is binary modular. If ac— and ni G co, then > L since 
L contains a cp"'-maximal lattice by Lemma 3.6. If acr and nl C 4a, 
then 7>L since L contains a 4a*o-maximal lattice by Lemma 5.4. 
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The elimination of the two above cases and the fact that «€ Q(L) 


means that 
a == Éa -+ 26 + 70, È and y in o, 


where |a |= | £a | > max {| 2é|,|¢|}; this involves a straightforward com- 
putation which is omitted. Since nL C nlf, we have || S |é|. Now. 


i Le[* J=, say. 


Clearly a€ Q(K); in fact « must be a norm generator of gK and therefore 
K = &,(a,8a%n*") where pP—£o. But then, K < 6;,(a, Sans) = 1, and 
so I>L as required. . 

Next if ! is binary but not modular, we have >L if and only if h> L 
where a = ao, (cf. 4.3). But it is easy to see that la is a binary «o-modular 
lattice, and that a is in Q(l,) and is a norm generator of gla. Therefore 
la— L by the first part, and so > L. 

If dim]—41, the result is trivial since 1 = (a). 

We now want to show how to determine if «€ Q(L) in the situation of 
Theorem 6.12. This is particularly desirable since as the theorem stands, 
the conditions given for dim/—1 are tautological. Lemma 6.13 is of wider 
interest though, since it enables one to determine Q(Z) for a binary modular 
lattice L, (cf. Theorem 7.4). 


Lemma 6.13. Let L be a binary unimodular lattice and let ac Q(L) 
be a norm generator of gL. If a€ nb, then a€ Q(L) tf and only tf a€ Q(FL) 
and 
(4) (d(aa) )? C 4anL + (d(—dL))*. 


Proof of Necessity. Since a€ Q(L), we have 
(5) a == Ea + Rén + ne, E and qE o, 


where L= @(a,c). Suppose b(aa) D b(—dL) =aco. If &a€ ao, then 
upon multiplying (5) by a, we see that (b(aa))?C (2&a)*0 C 4anL as 
required. If éa¢ ao, then c—0 (since otherwise the principle of domination 
leads to a contradiction), and it is easy to see that | €a |= | 26| S| 2£]. 
Thus |é@|=|2| and |aa|<|4|, whence (5(aa))?C (aa)*0 C 4anE as 
required. 


Proof of Sufficiency. If aa, then 
(b (aa) )?— (aa)*o C 4aao + (ac) #9 
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If (aa)? € 4aao, then a€ 400; if aa € aco, then a€ co. In either case L 
contains an ag-maximal lattice (by 5.4 or 3.6) and so a € Q(L) by Lemma 5.3. 

We can now suppose that a~ a, and also ag co +4ato. Since it suffices 
to show that «e? € Q(L) for any unit e, we can assume that a == m?ta -+ y where 
(aa) = ayo C ap —aao. The condition (4) is equivalent to y€ 2p*-+- co; 
thus y is in the norm group of the lattice L’ == (r*a, c)—note that nL’ = ap 
since a¢ co+4a!o.: By O’Meara’s theorem on modular lattices L’ = 6;(a, c) 
for suitable c’, and therefore a € Q(L’). But i= 0 since ze nL, so that I’ > L 
and therefore ae Q(L) as required. 


Remark. The following theorem gives a complete solution for I>L 
when dim!—=dimL and L is unimodular. For dim L Z 38, it is essentially 
just a restatement of results given earlier in this section; on the other hand, 
the conditions given for dim L—2 are not those of Theorem 6.12, but present 
an alternative solution. 

It is convenient to introduce the notation 


L K;=K, 1K: L: id "I Ky. 
ıS/Sn 


Frest Marn Tueorem. Let L be a unimodular lattice and let l be 
another lattice of the same dimension. If dimL 23, let 8=-81,* where 
t—=11:--1k ts a Jordan splitting and r is the largest integer such that 
dim (4% Z3. Put m=nb +nl# if dimL>3 m—=nL if dmLS2. 

r = 


Let a be a norm generator of gL. Then necessary and sufficient conditions 
for >L are: Flex FL, SIC5L, glm C gL C glm* and 
(2) gL glay + gm” if dim L223 and nl? Cm 
(3) a€ Q(ln*) if dimL = 3, nl¥8 C m and 8 C 8lm*. 

Remarks. The conditions under which (3) is non-empty are such that 
Lemma 6.10 can be used to decide whether or not a€ Q (lm*). 


The ideal m can be defined simultaneously for all values of dim by 
using the “ partial Jordan splittings” introduced in the Concluding Remarks 
at the end of the paper. Namely put k =1* and let 38 — [f] pf where j runs 

J 
over all integers such that dimf,,=2 (thus 8 is the same ideal defined in 


the theorem if dim L S3, while 8 = 0 if dim 22); then eer 
since B—0 if 3-0. 


Proof of Necessity. The conditions Fila: FL, 81C 8L, and gm C gh 
C glm* are obvious. Suppose dim L = 3 and n Cm. Then dim], S 2 since 
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8 — ]* jif dimh = 3. I dimi==2, (resp. if dimh; = dimh} =1 and 
dh~ dl,), then (2) and (3) follow from Theorem 6.9 (resp. Theorem 6.11). 
Tf dim l; = dim lı = 1 and dy, dl, or if dim h = 1 and dim h = 2, then a 
straightforward application of the principle of domination shows that 8 — 8ln* 
so that (3) is empty. But §—3l,* implies that In*##<-1," and so (2) is 
fulfilled. 


Proof of Sufficiency. If dim L==1, then Fl = FL and 818 clearly 
suffice. Suppose dim L = 3. If dim], = 3, then 1» L by Theorem 6.6 since 
lC ln implies gk Cgh Cal. If dim = 2, then I>L by either Theorem 
6.7 or Theorem 6.9. Suppose dim h ==1. If dim lı = 1, then the theorem 
follows directly from Theorem 6.11, (i) and (ii); note that in (ii), the 
ideals 8 and m are the same as defined here. If diml,,= 2 (anddim d;—1), 
then a==81;,,*m whence KL Ch Thus gla gi C gla* and so lob 
by Theorem 6.11 (iii), as required. 

Now suppose that dim L =—=2. If 1 is not modular, it is easy to see by 
the principle of domination that (la)m==lm where a==(nl)-+. Since la is 
modular and !— la, we may therefore assume that } is modular. By Lemmas 
4.4 and 4.5 lm is either a hyperbolic plane 9%, or a binary modular lattice with 
nlm* == m = nl (since nL C nlm*). Lf Ince My, then nf Ya = Gla, 0) 
and so > lm == Ci(n*a,0) —> Q (a,0) =L, since Blm C glm* implies that 
+= 0. 

On the other hand if nlg*—=nZ, then Im* = (a, 8am) where 
_ dL —1-+-8, }(1—8) = 80, and « is a norm generator of gL contained 
in Q(L); since tln*==-nD and gl Cglm*, a is also a norm generator of 
Glm*. Thus I> lm = lilna, Sat) > E (a, 8a) =L as required. . 

The next theorem is largely contained in the First Main Theorem, and 
is somewhat weaker since the condition Q (1) C Q (L) C Q(I*) is stronger in 
general than glC gL C gl*. Nevertheless it was considered worthwhile to 
single the result out since the modular case' is fundamental for the represen- 
tation theory, as it is for the equivalence theory. 


Sroond MAın THrOoRREM. Let L be unimodular and let 1 be a modular 
lattice on the same space as L. Then l— Lif and only if Q() C Q(L) C OA). 


Proof. The necessity is obvious. Therefore suppose that Q(1) CQ(L) 
C Q(I*); thus also ghCgLCagl*. It 8 = pt, Q(I#) =Q (1), whence 
42 0, i.e. 851C 8L. The theorem follows by Theorem 6.6 if dim L = 3, and 
is also clear for dim L=1. If dimL-2, the theorem results from 
- Theorem 6.12. 


QUADRATIO FORMS OVER LOOAL FIELDS. 57 


7: ‚Representation when the dimensions differ. _ 


Turep Marn Tuzorem. Let L be a unimodular lattice of dimension 
= 3, and let 1 be another lattice with y= dim L—dim! > 0. Then necessary 
and suficient conditions for I>L are: 2 


(i) if v=1, LL dl dLy > L. 


(ii) if v= 2, Li <a> L<a-di-dLy—>L where a is a non-zero field 
element such that FIL <a)—> FL and ae 4(gi*)-. 


(iii) if v3, 3IC8L, Col. 


"Remark. The representations in (i) and (ii) can be tested by thé results 
of 86, e.g., by the First Main Theorem. — 


Proof of Necessity. Put a= (814). Lf y= 1, there is a unary (almost) 
a-modular lattice k such that 114->L by Theorem 5.1. It is easy to see 
that | di |< | dk |, and therefore that dl- dL € dk- o? by discriminants. Thus 
LL gdl-dly > Lk L. 


Next suppose v=}. By Theorem 5.1 there is a binary (almost) a- 
modular lattice k- such that ILE>L. It is clear that FP ox Fk where 
Psa) 1 <a: dl- dLy. Moreover nP C 4a since di-dLEo. If k is modular, 
it contains a 4a-maximal lattice M by Lemma 5.4, whence P>M->k by 
Lemma 5.3, and soll Pollk—oL as required. If k is almost rn 
then & is a-maximal and so lL P—>lLk— ZL again. 

The necessity is trivial for v= 3. 


Proof of Sufficiency. The cases y & 2 are trivial, so suppose v= 3: By 
splitting hyperbolic planes off L, we can assume that v3 or 4. By field 
theory, FILV=FL for some space V of dimension v. Define b—an bo 
where b is a base generator.of gl. By 3.14, 3.15 or 3.16, there is an (almost) 
b-modular lattice k on V with norm group b. It is clear that g(l Lk) G gE 
Cg(lLk)* and so I>!1Lk—>L by Theorem 6. 6. This finishes the proof 
of the Third Main Theorem. : ; 

We remark that the only case. of different‘ dimensions not covered by 
the Third Main Theorem is dim L=2, dimi=1. .But this has been done 
previously in Theorem 6.12 (or better, Lemma 6. 13). 

The rest of 87 will be devoted to alternate solutions for the case v=. 
One of these, namely Theorem 7.2, actually gives a simpler answer than that 
in the Third Main Theorem, (ii). The other, Theorem 7.3, is ostensibly 
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more complicated, but certainly is at least as simple from a “practical” point 
of view. ~~. 


Lemma 7.1. If L is a maximal lattice of dimension = 2, then gL =n.. 


Proof. It is easy to see that there is a binary (almost) modular sub- 
lattice Z’ of L which splits L, (consider a Jordan form of L); I is clearly 
‚maximal. It suffices to prove that gl’/==nJZ’. Thus we can assume that 
dim L — 2. 

The consideration of a canonical form of L shows that there are elements 
g and 8 in F such that nE == ap == Bro, and such that a and a -+ 8E Q(FL) 
if d(—dL) m or « and BE Q(FL) if d(—dL)—m. By 91:3 of [4], 
Q(L) =Q(FL) N nL, and the result follows immediately. 


THEOREM 7.2. Let L be unimodular, and let l be a lattice such that 
dim 1 == dim L —2, and nb Cnl¥. Then I>L if and only if Flo FL, 
81 C8L, and gl gL. 


Proof. Put 3=81* and choose a rational integer ¢ such that pt C 4p8-. 
By Lemma 5.2, there is an (almost) p*-modular lattice k such that gk C gL, 
FILFk= FL. If kis almost modular, then 1->114—L by Theorem 6.11 
(i). Suppose k is modular. By Lemma 5.4, &* contains a 4p"'-maximal 
lattice M*, (we put M = (M*)*). Now nM*D8Dm=n(l Lk)”. Also 
gkm* > gMm* D pm by Lemma 7.1 since M* contains an m-maximal lattice 
M’, and clearly Mm D W. Thus g(11&)m* = gl* + ghm* D mD gL, and so 
I>11k>L by Theorem 6.7. 


THEORRM 7.3. Let L be unimodular, I a lattice with dim l == dim L— 2, 
BIC 8L, and nlf CnL. Suppose that FILV=FL where V is a binary 
space with (dV)-*b(—dV) —80. Let a be a norm generator of gL, and 
define a as 

gi ws A 
a if a€ Q(V). 
Then lL if and only if |a| €|Q(V)| and 


a+ 6 cell + rtg 
where 81# == p+ and g is the norm group generated by na and aà. 
Remarks. 1). The conditions of 81Co and nl#Co imply that no 
component 4 in a Jordan splitting of I! has nl; == 81,; thus } is the direct sum 


of binary modular lattices, whence dl~ 1, whence dV —di-dL-—1. Thus 
sep. 


QUADRATIO FORMS OVER LOCAL FIELDS. 59 


2). The condition |a| €|Q(V)| is easily seen to be equivalent to the 
fact that V is not isometric to <ax> 1<—Aam>. Thus if this condition holds 
and a¢ Q(V), then 8¢ 40 and so |a|==|a|. 


Proof of Necessity. By Theorem 5.1, LLR L for some binary pt- 
modular lattice R. Thus we also have L> (112)m*—1*1Rm* where 
m= nL D nlf. The lattice Rm is modular by Lemma 4.4, and 8R C 8Rm = pi, 
say. It is evident that 


28Rnt C BIC nb Crkm*; 


from this it follows that n —nRm* by Lemma 4.5. Therefore |a| € | Q(V)], 
and also we can write Rms 6;(ao7*/,a 78) where |a,.|—=|o|— |a|, and 
dV = —1498, |¥|—| 8]. 

By the choice of a and Lemma 3.7, b(aa) Cd(aa.) and therefore 
aon*J € gL implies that ar’ € gL, since ji. If ad € 2p, then a8 € 2p/ C gL 
since | aots ] =] a8]. I£ ao’? ¢ 2p), then aot% ~b where b is a base 
generator of gL; therefore ade aoto C bo since gRm& gL. Therefore 
gC gL and so gl + gC gl. 

Next let us define R’ = By (a, 78-94). Clearly gl# + gR’ C gl# + rtg. 
Now gi Cgl*-+gRmf and gl*#+-gRm*—=gl#+ qR’ by Lemma 6.8 (note 
that a is a norm generator for g(J1Rm)* since a€ gl Cg(11Rm)* and 
n(l1LRn)#=—ao=ao). Therefore gl C gl* + mtg. 


Proof of Sufficiency. Since |a|€|Q(V)| and by Lemma 3.7, there is 
an a€ Q(V) such that |a, |== |a]| and d(as,) = b(aa). Let v= 0 be the 
smallest integer such that o,18’n** € pt, where dV = —1-+-% as in the proof 
of the necessity. If we define P= (A, (mt*a,, a, 18x), then FILP)=FL. 
We shall show that 11 P-L. 

Suppose first that nP = a,p”*, so that in particular, v0. If we define 
P = Cy (n*#a, a8), then g(t 1 P’) *¥ = gl? + 74g, and furthermore g(J 1 P’)* 
—g(lLP)* by Lemma 6.8 since a is a norm generator of gl*+- wg. 
Therefore gL C g(11P)* and also l 


gP C zt (gl* + rtg) Col+g 
since CL Hence g(!LP) G gL. 


Now suppose that nP D «a,p*. Then a straightforward calculation shows 
that gP D a,p*4 whence gLCnZb CgP*. It is also clear that 8—~ m, so that 
ao C gL since gC gl. But nP D a,p°t also implies that nP C «80; hence 
g LP) Col. 
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We have therefore shown that F(ILP)=FL and that g(ILP) Cgb 
CgULP)*. It follows that ILP>L by Theorem 6.6, and so the proof 
of Theorem 7.3 is finished. 


THEOREM 7.4. If L is unimodular, and gL = ao? + bo, then 


dL: 9? 5 if dim L == 1 
gay) (ee 0 | (Blaa)! C dant + (0(—dL))*} N QPL) if dim L=? 
gL N Q(FL) if dim L =3 
gl i if dim LZ 4 


Proof. The theorem is obvious if dim L==1. If dim L=2, it results 
from Lemma 6.13. Theorem 7.2 proves it for dim L==3, and the Third 
Main Theorem, (iii), takes care of dim L Z 4. 


8. Concluding remarks. What can be said about thie general problem 
of 1+ L where L is not necessarily modular ? 


First suppose that yum dim L— dim I> 0. If v=] or 2, then the 

“reduction” to y= 0 given for a unimodular lattice L in (i) and (ii) of the 
Third Main Theorem of § 7 are also valid in this more general setting, if in 
(ii) the ideal 4(87*)+ is replaced by 4(81#)- N 4(8L*)-, (and if 82 Co). 
A solution for y= 3 would depend more directly on the case v==0. 
* Let L=, L-1 Lp be a quasi-Jordan splitting and ==], L> > -Ll 
be a quasi-Jordan splitting. Define Q=0 if 8L Cpl, otherwise put 
Q= L,1-++LL, where r is the largest integer such that p/C8L,. Define 
I, similarly, using the splitting =h L> > -Lle Suppose that ¢: 1>L, and 
that 8, C p/ C 81. Define the linear mapping y: I, > & by d(z) =y(z) +7 
‚where zEl, w(x) EQ, and MER* It is easy to see that y is injective 
(ker y==0) and so diml;=dim&%, Thus a necessary condition for I>L 
is that diml,=dim%, for all values of 7. The following theorem is a 
generalization of Theorem 6.6. 

THEOREM. Let l and L be lattices on the same ones (in ana: 
dim } = dim L) and suppose that 


(6) dim 2, = dim 4y +3 for ord (8L) Sj < ord (84) 
dim 2, = dim I; otherwise. 
Then l-> L if and only if glC gh and gL C gls*, where 8— (8l). 
Proof. The proof of the necessity is straightforward and is omitted. 


The proof of the sufficiency proceeds by induction on N (1, L) = T -ord (8l). 
By scaling ! and L if necessary, we may assume that 8L—o. Putting 
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j==ord(8l) in (6), we see that 81C 8L, so that N(l,L) 20. Also dim L 
= dim L, Z= 3 follows from (6) for j==ord($E). If N{lL) 0, then 1 
and L are both unimodular or almost unimodular and so l = L since gl == gL. 
Suppose then that N(,L)>0. Let 8l,—p*. Condition (6) for j =t shows 
that 8l; C 8L; since ==] and dim l= dim L. 


First Case: 8l C 8L; The induction: step for this case is almost the, 
same as that in Theorem 6.6. By the same theorem, we can suppose that 
T>1, whence 8, Cp?. Now diml,=3 by (6) for j=ord(54,) —1, Thus 
we can suppose that the quasi-Jordan splitting for J has been chosen so that 
(mL) = gl*. Then we find an’ (almost) p**-modular lattice k on Fh 
with gk==gh Opn w?gl. Put J=4* Lk. Then I>J since „> k, and 
gI Egl. If 8 pt — (8k), then l ' 


gJ ay > g (mtk) = 120) me (wing L) N pt A righ 
D gla? N glhf = gly’. 


Thus gLẹ* C gJg*. But J inherits the properties analogous to (6) from J, 
and N(J,L) <N(l,L). Therefore J>L by induction, and so lo JL 
as required. 


Second Case: 8l; —=8Lr. We shall assume again that g(7#l,) == gls* r; 
since dim L, 23, a similar argument allows us to assume that gli = gL. 
Condition (6) shows that dim l; = dim Lr + 3. The reader can easily check 
that (iii) of the Third Main Theorem remains valid if L is almost uni- 
modular instead of unimodular. Therefore Lr— h since 


gr = a ghost C aiglst = wig (atl) = gh, 


whence l; = Lp 1J for some (almost) modular lattice J of dimension = 3. 
But FJ supports an (almost) p*-modular lattice K with norm group gK 
= gA + gl: = gli; this can be proved by first applying one of 3.12 and the 
necessity of 3.15 and 3.16, followed by one of 3.14 and the sufficiency of 
3.15 and 3.16. By equality of norm groups, l; = Lp LK. Define ’—1,*7 1K 
and L’ == Dn*. Clearly V and L’ satisfy the conditions analogous to (6), 
and Fl’ = FL’ by Witts Theorem. Also 


gl = gl C gL = gl, =— gI” 
gL’? C gL¥ get = g(a) = g(a tK) = gist. 


Since N(Y, L’) < N(L L), V > L’ by induction. Therefore l = V L 0,3 I 11; 
== D as required. This finishes the proof of the theorem. 
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ÜOROLLARY. Lei land L be two lattices such that 
(7) dim 2, = dim !,-+ 3 for j 2 ord(8Z), 


(in particular, dim L—diml2 3). Then I>L if and only tf SI! C 8L and 
gl C gh. 


Proof. The proof is omitted. It is entirely similar to the proof of the 
“Third Main Theorem, (iii), with the above theorem being used instead of 
Theorem 6.6. 

In this paper, we have given a complete solution to the problem 12> L 
when L is modular, and only a partial solution when L is not modular. The 
theory remaining to be developed is as follows, where y == dim L — dim}, and 
L is not modular: l 

v==0: L does not satisfy (6) 
v=3: L does not satisfy (7). 


Of course, the “reduction” to y= 0 given earlier for y= 1 or 2 will be a 
solution only when the case y= 0 is completely solved. 


MOoGILL UNIVERSITY, 
UNIVERSITY OF NOTRE DAME. 


REFERENCES. 





[1] H. Hasse, “ Symmetrische Matrizen im Körper der rationalen Zahlen,” Journal für 
die Reine und Angewandte Mathematik, vol. 153 (1924), pp. 12-43. 
[2] B. W. Jones, The Arithmetic Theory of Quadratic Forms, Carus Monographs, No. 
10, Mathematical Association of America, 1950. 
[3] O. T. O'Meara, “ The integral representations of quadratic forms over local fields,” 
American Journal of Hathematios, vol. 80 (1958), pp. 843-878. 
, Introduction to Quadratic Forms, Grundlehren der Mathematischen Wissen- 
schaften, Springer-Verlag, Berlin, 1963. 





[4] 


QUASICONFORMAL MAPPINGS AND EXTREMAL LENGTHS. 


By H. Rensenı.* 


1. Introduction. In our attempt to study homeomorphisms which pre- i 
serve curve families with extremal length zero, we found the rather surprising 
result that these mappings are quasiconformal in the geometrical sense 
(Definition 1’ and Theorem 1’). 

In selecting special families of curves with extremal length zero, we have 
been able to give a full characterization of quasiconformal mappings by homeo- 
morphisms which leave exactly these selected families invariant (Definition 1 
and Theorem 1). 

Hence this property can be used as a definition of KERNE map- 
pings. Furthermore it can advantageously be applied to the study of invariance 
and continuation properties of quasiconformal mappings. 

We would like to draw attention to the following fact only: A. Beurling 
and L. Ahlfors [2] have pointed out that under a quasiconformal mapping 
of a half plane onto itself— which implies a homeomorphism of the boundary 
line—neither the class of sets of Lebesgue measure zero nor the class of sets of 
harmonic measure zero situated on the line is preserved. 

Therefore it is of some interest to give an example of a class of null-sets 
which is preserved by the induced homeomorphism of the boundary (Theorem 
2). 


2. Two lemmas for extremal lengths. The definition and the main | 
properties of extremal lengths have been given by L. Ahlfors and A. Beurling 
[1]. An account of the theory of extremal lengths can e.g. be found in [7]. 

The first lemma will be proved for families of curves in the complex 
plane ; but it can readily be generalized to families on a given Riemann surface. 


Lemma 1. For eachi (t—=1,2,8,- - -), Ts is a family of curves yı lying 
in Gu, where the G, are disjoint measurable sets. Let T =U Ti. Then 
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Proof. (I) Since T; CT, we have A(I;) 2 A(T) for every i I£ A(T) =0 
for some 4, then the lemma trivially holds. Let therefore A(T.) 340 for every 4. 
To every 2 &> 0 there is a pı defined on G; such that Lr, (p:i) Z1 and 


Fr, (a) S — un ) 
admissible for T and Lr(p) 21. Furthermore 


+a. But p defined by p==p; in G; and zero elsewhere is 


1 
ME) <A) Zr (p) = Sate 


where e= > «. Hence —— 


> ) , and the lemma trivially holds if 
A(T) =0. 


m SÈT) 
(II) Let an) #0. To every 7 >0 Busse p such that Lr(p) >1 
and ole) Sg +y. Let p be the restriction of p to G. Then 


i 1 
Sims Parey) = m) MT) * 


The second lemma deals with families in the complex z-plane. 


= SFr, (ps) < Fr(p) and hence Sr 


Lemma 2. Let M be a family of curves such that each curve p given 
‘by y(t), continuous on OSt=S1, satisfies Iz,(t) >0 for O<t<1 and 
“Aza (0) = 92,(1) =0. 

Let N == {v} be the reflection of {p} in the real avis and let T be the 
family of all closed curves y such that y contains exactly one curve p and 
exactly one curve v. f 

Then AM) =A(N) Hm). 


Proof. (I) That A(M)—=X{(N) is obvious by symmetry. From the 
definition of T one gets, by a known property of extremal lengths, A(M) + A(N) 
SAT). 


(II) Let A(T) 40. Then to every e> 0 there is a p such that Fr(p) 
= 1 and A(T) —eS L*p(p). 

Let p = p(z), p—=p(Z) and p= $[p +- 4] for every z. By an application 
of Schwarz’s inequality one gets Fr(p) 1. Since F is symmetric to the real 
axis, Lr(p) can be approximated by choosing curves also symmetric with | 
respect to the real axis. Hence one concludes easily that Lr(p) 2 Lr(p). 

Let be the restriction of p to the upper half plane. is admissible for 
M and Fy(f) =4F rip), Lulh) =4Lr(5). Therefore as 


AT) es Lrg) 2 ete) <2a(M). 
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Similarly one shows that if A(T) =», then A(M) =o. 


8. A characterization of quasiconformal mappings. A quadrilateral 
Q (in the plane) is the interior of a Jordan curve O on which four distinct 
points have been selected.‘ These four points divide C into four arcs, the 
sides of Q. A quadrilateral on a Riemann surface is defined by a topological 
image of QU C or simply of Q. 


Definition 1. Let Q, be a quadrilateral on a Riemann surface. The 
family T; of all curves y, ye C Qi, which join two opposite sides of Qu, is called 
a simple quadrilateral family. Any (necessarily countable) union T=UT; 
of simple quadrilateral families such that the corresponding Q; are mutually 
disjoint is called a quadrilateral family of curves. 


THEOREM 1. A topological mapping f of one Riemann surface onto 
another is quasiconformal in the geometrical sense if and only if the set of 
quadrilateral families whose extremal length is zero ts invariant under f; 
i.e. for any quadrilateral family T the extremal length A(T) = 0 if and only 
tf A(T”) = 0 where T” denotes the image of T under f. 


Proof. For each simple quadrilateral family T; let m; be the modulus 
reciprocal to A(T;). Applying Lemma 1 one immediately concludes that 
Theorem 1 is equivalent to the main theorem in [8], whose generalization te 
mappings of Riemann surfaces is quite trivial. 


Definition: 1”. We denote by f* a homeomorphism of one Riemann surface 
onto another such that the set of families of curves whose extremal length 
vanishes is invariant under f*; i.e. for any family T of curves, A(T) —0 if 
and only if A(I”) —=0 where I” denotes the image of T under f*. 


THEOREM 1’. Every differentiable quasiconformal mapping is an f* 
and every f* is quasiconformal in the geometrical sense. 


Proof. Let T be a family of curves and let I” denote its image under a 
given differentiable quasiconformal mapping. Then it is well known that 


there is a constant K=1 such that = MT) SAT)SKA(T) for any T. 


Hence the first statement of Theorem 1’ holds, whereas the second is an 
immediate consequence of Theorem 1. 


4. Some invariance and continuation properties. Most of the results 
in this section have been announced in Bulletin of the American Mathematical 
Soctety, vol. 63 (1957), pp. 273-274 and Notices of the American Mathe- 
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matical Society, vol. 5 (1958), pp. 148-149. But also other authors [5], [6], 
[9], [10] have treated the problems independently. We nevertheless give a 
summary hoping to have unified and simplified some of the questions. 

Let @ be a domain in the Riemann sphere R.. Any boundary component 

of G is either a point denoted by og or a continuum. By a continuum we 

mean a compact connected set consisting of more than one point. We will 
“only deal with the set Be — {ag}. : 
H. Grötzsch [4] was the first to start to classify Bg by giving 


Definition 2. oa is called “completely point-like” (with respect to @) 
and denoted by o«* if and only if for every conformal mapping of G into R, 
og corresponds (in the induced boundary correspondence) to a point (and 
hence never to a continuum). Sur 

Using conformal mapping onto a minimal circular slit domain one proves 
(preferably by contraposition) 


Proposition 1. Let C be a Jordan curve, C C G. C decomposes R into 
three parts, R’, R” and O. LetoseR and =R NG. Let T be the family 
of all closed curves y, y C @’, such that each y separates og from O (with 
respect to R). Then og ts a og* if and only if A(T) =0 [5]. 


It can be shown that A(T) ~0 is independent of the special choice of 
C, and that there is a T*, T* CT, A(T*)—=0, which can be considered as 
a quadrilateral family (according to Definition 1). Hence we can apply 
Theorem 1. Using these remarks one gets successively: 


COROLLARY 1. Let U be ae-neighborhood (in the chordal distance on R) 
of a given og and let V be that component of GN U whose boundary contains 
og. Then og is a og* if and only if oy (og) is a op*; ie. being “ com- 
pletely point-like” is a local property. 


COROLLARY 2. Let GU Ba bea domain. Using the terminology of [1], 
every og 18 a og? tf and only if every compact subset of Bg is a set Na» [10]. 


COROLLARY 3. If oc is a og*, then it is also “completely point-like” 
with respect to the larger class of quasiconformal mappings. Especially the 
sets Na» are quasiconformally invariant. 


COROLLARY 4. Any quasiconformal mapping of G can be continued to 
a topological mapping of GU Be if and only if any ca is a og*. If the 
continuation exists, then tt is unique [6]. Hence this property could have 
been used to define a og*. 
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Another step in classifying Bg is done by 


Definition 8. Let GU Be be a domain. Ba is called “conformally 
[resp. quasiconformally] removable” (with respect to @) if and only if every 
conformal [quasiconformal] mapping of G into R can- be extended to a con- 
formal [quasiconformal] mapping of GU Bg. 

This is just another way of defining the sets Np, since by using Corollary, 
4 and [1], Theorem 5 and § 5, one can readily show that any compact subset 
‘of Bg is a set Np if and only if it is “conformally removable”. 


COROLLARY 5. Let UF, U C GU Bg be a e-neighborhood (in the chordal 
distance of R) of a given og. Then Bg is “conformally removable” if and 
only if for every og the set By = Ba N U ts “conformally removable” (with 
respect to V=GOU); ie. being “conformally removable” is a local 
property. 

The following result is a sharpening of K. Strebel’s Theorem 1 [12]. 


Proposrrion 2. A set Ba ts “ quasiconformally removable” if and only 
tf it is “ conformally removable”. 


Proof. (I) That conformal removability implies quasiconformal remov- 
ability follows from [12]. 


(II) Let N be a compact subset of Bg and let f map R— N conformally 
onto a minimal parallel slit domain. By hypothesis the restriction of f to @ 
can be extended to a quasiconformal mapping 7 of @U Bg. We note that 
(N) has area zero. Hence also N has area zero, since the quasiconformal 
f> is measurable by [3]. Using the hypothesis, the measurability property 
and [1], Theorem 4, one concludes that N is a set Np and therefore by the 
remark following Definition 3 that Bg is “conformally removable”. 


From Proposition 2 follows 


CoRroLLARY 6. The sets Np are quasiconformally invariant [9]. 

As a final remark we want to mention that Definition 2 does not imply 
Definition 3 ([1], Theorem 16); i.e. topological continuability does not 
imply conformal continuability. 


5. Boundary correspondence. That a quasiconformal mapping of a 
Jordan domain onto another can be extended to a homeomorphism of the 
closure is a classical result of quasiconformal mappings. Nevertheless we give 
an outline of another proof in order to illustrate the applicability of our charac- 
terization of quasiconformal mappings. Furthermore, E. C. Schlesinger [11] 
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has made a study of prime ends using families of curves with extremal length 
zero. It would be easy to show that his whole study and hence the classical 
results on prime ends can be carried over to quasiconformal mappings. 


Proposrrion 3. Let D bea domain (in the Riemann sphere R), bounded 

by a Jordan curve C, and let f map D quasiconformally onto another domain 
„PD, D’ C R, bounded by a Jordan curve C. 

Then f can be extended to a topological mapping of DU C onto D U C. 


Proof. Let K,K C D, be a continuum and p, p€ C, be a point. Let r 
be the family of curves which separate p from K with respect to D. Since 
p is an accessible point, it is easy to show that A(T) =0, using known 
properties of extremal lengths. Furthermore I will contain a quadrilateral 
family T*, [* CT, with A(T*) = 0. Using Theorem 1, one concludes that 
A(T’) =0, where I” denotes the image of T under f. Hence p cannot 
correspond to any continuum on the Jordan curve C” because otherwise one 
would get A(T’) > 0. The proof of Proposition 3 can now be completed along 
classical lines. 


Finally we prove 


THEOREM 2. Let D be a domain (in the Riemann sphere R), bounded 
by a Jordan curve C. Let f map D quasiconformally onto the upper half of 
the complex plane. 

Let N, N CC, N compact, be such that every point of N is completely 
pownt-like (according to Definition 2) with respect to R—N, i.e. N is a 
set Ns». 

Then the image N’ of N (by Proposition 3) is also “ completely point- 
like” with respect to BR— N’, i.e. N’ is also a set Na». 


Proof. By hypothesis every point p, p€ N, is accessible from D. Let 
K, KC D, be a continuum, let q€ K, and let O* be an are, represented by 
z(t), continuous (in the chordal distance) on 0OS¢X1 with z(0) = Q, 
z(t) € D for 0O& t< 1 and z(1) =p. According to Proposition 1, the family 
T of all curves y, separating (with respect to R— N) p from an appropriately 
chosen Jordan curve passing through g satisfies A(T) = 0. . Every y intersects 
D along certain arcs. Let for any yET, y be one of these arcs, which also 
intersect C*. ‘Then every such y will separate g from p with respect to D. 
By known properties of extremal lengths, A (Y) —0 where Y= {y}. Hither 
Y is already a simple quadrilateral family, or contains a quadrilateral family 
whose extremal length is zero. Let & denote this family. Using Theorem 1, 
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ı(W) =0, where & denotes the image of Y under f. Applying Lemma 2, 
Y can be identified with a family M and hence the family of all the curves 
which separate with respect to R— N’ the image of p’ of p from a certain 
Jordan curve on R, has extremal length zero. Hence by Proposition 1, p’ is 
“completely point-like” with respect to R—WN’. 


It is trivial that Theorem 2 can be generalized to mappings f of D onto | 
domains bounded by piecewise analytic arcs. 

For quasiconformal mappings of the upper half plane onto itself the 
question of boundary invariance of all the known function-theoretic null-sets 
is now settled by means of [2], Theorems 12 and 13 of [1] and our Theorem 2. 


ALBUQUERQUE, New MEX100, 
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GENERALIZED AUTOMORPHIC FORMS AND CERTAIN 
HOLOMORPHIC VECTOR BUNDLES. 


By Mrxio Iss. 


Introduction. Let X be a symmetric bounded domain of N-complex 
dimensions and let T be a properly discontinuous group of holomorphic auto- 
morphisms of X with the following properties: 


(a) The quotient space T\X (=F) is compact. 
(b) Any element yET different from the identity has no fixed point 
in X. 
These two conditions imply that Y is a projective algebraic manifold (without 
singularities) by a theorem of Kodaira [15]. A mapping R of rX X into 


the complex general linear group GL(m,C) (m=i) is called an auto- 
morphic factor, if R satisfies the relation: 


R (yY, z) =R (y, Yz)kly, x) 


for y, y ET and z€ y, and further if R(y,x) is holomorphic with respect to 
the variable z € X for any fixed y€ T. By an automorphic form f with respect 
to T for the automorphic factor R, we mean the holomorphic mapping f of 
X into the m-dimensional complex cartesian space C” which satisfies the 
equalities : 

f(y, t) = R(y,2)f (2), 
for ye T and ze Z. 


On the other hand, to such an automorphic factor R corresponds an (m- 
dimensional) holomorphic vector bundle Er over Y =T\X in the following 
fashion: In fact, T acting on the product manifold XX C™ such that 


ye (z,é) = (yz, R(y,2)£) 


for yE T and (z,é) € X X C”, we obtain the vector bundle Æg as the quotient 
complex manifold of XY XC™ by T. Then, it is readily seen that an auto- 
morphic form f with respect to T for automorphic factor R can be regarded 
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as a holomorphic section of the vector bundle Hp, and conversely. Therefore 
the space of these automorphic forms will be denoted by H°(Y,Ex).* 


The main purpose of the present paper is first to generalize the concept 
of the automorphic forms of type p introduced in [7] in the case of Siegel’s 
symplectic space to the general symmetric bounded domains, and then to 
compute the dimension of the space of these automorphic forms under the 
conditions (a) and (b). We shall now explain the contents of the paper: 

Let @° be a connected complex semi-simple Lie group and G! a com- 
pact form (a maximal compact subgroup) of G°. Further we denote by U 
a connected, closed complex subgroup of @° containing no closed normal non- 
discrete subgroups of G°; for which we assume that the complex manifold 
X*— (°/U is the compact symmetric hermitian manifold dual to X in 
the sense of E. Cartan. Then G*/K (K= UN G*) is a symmetric homo- 
geneous space for a suitable G* and is naturally identified with X*; moreover 
we know that there is a connected, non-compact real semi-simple subgroup G 
of @° containing K as a maximal compact subgroup of G. The (symmetric) 
homogeneous space G/K thus obtained may be identified with X.2 In the 
sequel, K° will denote the complexification of K in G@°, and p a holomorphic 
(completely reducible) representation of K° into GL(m,C). First, in 82, 
we will introduce the mapping J: GXX—Ke which will be called the 
canonical factor of automorphy (cf. Definition 1),* and define the automorphic 
factor Jp ==pod as the composition of p and J. In case X is the Siegels 
symplectic space, J is of a well-known form (cf. 89), and an automorphic 
form for the factor Jp is no other than an automorphic form of type p in 
the sense of [7]. In this section, we shall clarify the significance of J by 
showing the relation between the bundle E,, (we write also as E,.,) and the 
homogeneous vector bundle Hp** over X* in the sense of Bott [5] (cf. 
Proposition 1). Next we introduce the cohomology groups H¢(Y,E;,) over 
Y (resp. H9(X*,E,*) over X*) (OS q SN) with the coefficients in the 
sheaf of germs of holomorphic sections of Ez, (resp. of Hp“). The zero- 
dimensional cohomology group H°(Y,E,,) is the very space of automorphic 
forms with which we shall be concerned throughout this paper. We consider 
further the Euler-characteristic x(F,E,,) (resp. x(X*, Ep“) ) with respect to 


1 See the Notations at the end of this introduction. 

3 See, for detail, $1. ` 

3 We have learned this concept from I. Satake, which is originally due to A. Orihara; 
we are very thankful to them. 

‘For the definition of the homogeneous vector bundle Wp", we refer to $2, 6, and 
originally to [5]. 
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these cohomology groups. One of the main results in this paper is Theorem 1 
(in 88) which states the formula: 


(A) . x(F, Esp) = x(¥)x(X*, Ep"), 


where (Y) denotes thet arithmetic genus of the algebraic manifold Y. This 
formula is a generalization of Hirzebruch’s result (see [10, Satz 1 and Satz 4]), 
“and the proof shall be carried out by generalizing the proportionality in the 
sense of [10] to the Chern numbers of the bundles E,, and those of E,* 
(cf. Lemma 6 in 86). 

Our next task is to prove vanishing theorems for the cohomology groups 
H«(Y,E,) (¢=0). In fact in §7 we shall show that, under a cértain 
condition on p, 

(B) H«Y,E;,)=0 for allg>0; 


This is another main result of this paper (cf. Theorem 2). Combining (A) 
with (B) we see that 


(C) dim cH’ (F, E,,) —= x(¥)x(X*, Ep“), 


under the same condition as in (B). Here recall that x(Y) is computable, 
as Hirzebruch [11] showed, if we know the total volume of Y with respect 
to G-invariant metric in X (cf. §6), while that x(X*, Ep*) can be computed 
within the representation theory of G°, according to Bott’s results [5] (see 
for detail, Cor. of Theorem 2). We show in 87, moreover, theorems which 
give some sufficient conditions for H°(Y,E,,) —0. 

To prove these vanishing theorems for the vector bundle Ey., we introduce 
in $3 another algebraic manifold Yr—=T\@/T (T is a maximal torus of K) 
and the line bundle Fo over Yr which is determined by p. The computations 
of H9(Y,E,,) are then reduced to those of the cohomology groups H4(Y¥7, Fo) 
over Yr with coefficients in the sheaf of germs of holomorphic sections of Fy. 
Then, the vanishing theorems of Kodaira [14] can be applied to H2(Y r, Fe), 
if the explicit form of the Chern class of F, are known. (These methods 
are clearly analogous to Bott’s theory of homogeneous vector bundles; see [5]). 
Thus, our main results (A) and (B) shall be obtained by clarifying the explicit 
forms of the Chern classes of the vector bundles appeared in the above; 84 
will be devoted to these discussions. 

In concluding this introduction, we should like to express our thanks to 
Prof. Y. Matsushima for frequent helpful conversations with him on the 
present subject. We are also thankful to Prof. I. Satake for his valuable 
communication. 
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Note. After completing the present work, the author was informed that 
R. P. Langlands has calculated the dimension of the space of automorphic 
forms of type p under the condition (a) without (b) by using Selberg’s trace 
formula and some results due to Harish-Chandra (but, his condition on the 
representation p is somewhat stronger than that of ours in Cor. of Theorem 2, 
87). However, our vanishing theorems are new as far as we know, and these 
theorems remain valid even if the condition (b) is omitted, as the reader could, 
readily see by making use of Baily’s work (Proceedings of the National 
Academy of Sciences, U.S. A., vol. 40, pp. 804-808) in place of Kodaira’s [14]. 


Notations. i) Z, R and C denote the ring of integers, the field of real 
numbers and that of complex numbers respectively. ii) To denote a fibre 
bundle, we write as Z=E(X,F,G,r); where F, X, F, G and r will be the 
bundle space, the base space, the standard fibre, the structure group and the 
projection respectively. In the principal case, we omit the fibre without any 
change in others. iii) For a holomorphic vector bundle E, we denote by E 
the (analytic) sheaf of germs of local holomorphic sections of FE. iv) Lie 
groups are denoted by the great roman letters G, H, K etc., and their Lie 
algebras by the corresponding small German letters: g, 5, fete. v) A and B 
being two complex Lie groups, Hom(4,B) is by definition the set of all 
holomorphic homomorphisms of A into B; while, in case A and B are real 
Lie groups, by Hom(A, B) is meant the set of all differentiable homomorphisnis 
of A into B. In each case, for p€ Hom(A,B), we denote by p€ Hom (a,b) 
the differential of p. iv) + means the direct sum of vector spaces; for the 
real subspace a of a complex vector space, a° denotes the complex subspace 
spanned by a over C. vii) 1 will often denote the identity element of the 
group. 


CoNTENTS. 


$1. Preliminaries from the theory of Lie groups and hermitian symmetric 
spaces. 


§2. Canonical factor of automorphy and automorphic forms of type p. 


§3. The vector bundles Epos over Y=T\X and the fundamental bundle 
diagram. 


4. Line bundles over Yr. 
5. Chern classes and positive line bundles. 


§6. Generalization of Hirzebruch’s proportionality principle. 


74 MIKIO ISE. 


87. Vanishing theorems for the cohomology groups H#(Y,Ep.,). 
88. The proof of Proposition ?. 
§9. The case of Siegel’s symplectic space. 


810. Final remarks. 
References. 


§1. Preliminaries from the theory of Lie groups and hermitian 
symmetric spaces. 


1. This section will be devoted to a. brief summary of the properties of 
symmetric hermitian manifolds which should become necessary in the sub- 
sequent sections.’ 

Let X denote a symmetric bounded domain of N-complex dimensions, 
and X* the compact symmetric hermitian manifold which is dual to X in the 
sense of E. Cartan (cf. [6;10]). The group-theoretical descriptions of X and 
X“ are as follows: We denote by @° the simply-connected covering group of 
the connected holomorphic automorphisms group of X*; G° is a connected 
complex semi-simple Lie group, and X* is represented as the complex coset 
space @°/U where U is the connected closed complex Lie subgroup of G° 
consisting of all element of G° which fix a point (which we denote by z,*). 
A compact form G* of G° is also simply-connected, and acts on X* as the 
transitive isometric transformations group; therefore X* is also written as 
G*/K, K==G*U. Further we know that there is an involutive auto- 
morphism e of @* such that K coincides with the subgroup of G* consisting 
of allge G* fixed by e. Denote now by g” (resp. g°,£) the Lie algebra of G* 
(resp. of @°, of K), then the differential € of e yields the decomposition: 


g*=—Eim (hence g° = f° 4 m’). 
where m denotes the (—1)-eigen space of & in g*; we know further that 
Kulm [mm] =f. 
A non-compact real form g of g° will be now defined by 
g=t} v-Im (Co); 
then the real subalgebra g of g° generates in @° the connected real semi- 
simple Lie subgroup @ whose center is finite and simple components are all 


non-compact. K is then a maximal compact subgroup of G and it is known 
that 


5 For the theory of semi-simple Lie algebras used in this paper, we refer to [13]. 
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an@=K, GNTVT=H«NU—=K, 


and that @/K is identified with X. Therefore, if we define the mapping j 
of X into X* by 
j: 9gK>gU (g€@), 


then 7 yields an injection of X into X* which is compatible with the actions 
of Gon X and on X”. Thus X will be endowed with the G-invariant complex" 
structure from that of the open submanifold j(X) of X*; this coincides with 
the complex structure as a symmetric bounded domain (see, for these argu- 
ments, Borel [1]).° 


2. Now taking and fixing a maximal toral subgroup 7 of K (then it is 
also a maximal toral subgroup of G*), we denote by t the Lie algebra of T; 
the complexified form t° of t gives a Cartan subalgebra of fe and also of g°. 
In the sequel, we consider the Cartan decomposition of g° (resp. f°) with 
respect to t and the corresponding root system; for a root a, the non-zero 
element éa€g? such that [h, ca] =&(h)ea (het) and ®(ea, 6-a) —1 
(@ denotes the Killing form of g°) is called the root vector corresponding 
to & We will now identify m with the tangent space of X* at the point £o; 
then the tensor field I of type (1.1) defining the complex structure of X* 
induces a linear transformation I, of m which commutes with the adjoint 
actions of K on m and I)?==—-1. Then we have the decomposition 


m == nt itm, INT, 


where n* (resp. n`) denotes the eigen-space of I, corresponding to the eigen- 
value V—1 (resp. — V—1) (In other words, n* (resp. n`) consists of all 
complex tangent vectors at z,* (€ m?) which annihilate all local holomorphic 
functions at z,“)). Since AdK-m Cm, we see also 


Ad K-n* C n*, and hence [T° nt] C n. 
Therefore we have in particular [t°, n*] C n*; from this we infer readily that 
n* (resp n`) has to be spanned by some root vectors. We know furthermore 
that ea € n* if and only if e-a € n, and that we may choose a linear order for 
the roots such that if ea € n* (resp. ea € n) then a is positive (resp. negative) ; 
we will fix such a linear order once for all. It follows then that there is 
uniquely determined the simple roots system {a1,a,° °°, a} (l= dim T}; 


è The results of j stated in this section shall be, in reality, proved through the roots- 
arguments; which is given in the section 2, 3 and 4. 


76 MIKIO ISE. 


moreover there exists a set 3 consisting of some simple roots such that the 
derived algebra [¥°, f°] of f is the semi-simple Lie subalgebra of g° generated 
by all root vectors 6e, corresponding to «€ 3. A (positive) root & such that 
éa€ nt (ie. a is not to be expressed as an integral linear combination of 
a€ 3) is called a complementary (positive) root. 

Let u be the Lie algebra of U; then we know that n> Cu. Further we 
can show that nt (resp. n`) is an abelian subalgebra of g°, and that 


guint, uP iw; 
hence we have U==K°N-, (the semi-direet product; cf. 4). Now, for the 
Cartan decomposition of g° (resp. f°) with respect to t°, we put 
not =X Cea, no =£ Cea, PN Cea. 
a>0 XO” 


e„ele 

Then g? =t + mot + to, =t 4 po, and not are maximal nilpotent sub- 
algebras of g°; moreover we have f-=-t +p for p=penft([t, p] Cp). We 
define here the complex solvable subalgebras to, u, of g° respectively by 

. w=? tte ME; 
U, (resp. U1, No‘) denotes the connected complex subgroup of G? generated 
by wo (resp. t no) (Ui C Uo C U). Then it is easy to verify that 

KNU =T, GNU, =6*N Uo =T, Uy==TN,. 

3. On the other hand, ( , ) will denote the non-degenerate inner product 
induced on f by the Killing form of g°: For any linear form & on t°, there 
exists an element h'o Et? such that c(h) = (Roh) for all het We set, 
for two linear forms 6, r, (6,7) == (Mo, h’r) ; then (5,7) is a non-degenerate 
bilinear form on the dual space (f°)* of fe. Denote now by Ag (for € (t°)*) 
~ the element of t such that 7(h,) =2 (7,5) / (8,0) for any re(t°)*. For any 
simple root % (151551), in particular, we put ha, =h; We know that 
[ a, Qo | = ka = en ha for every root g. A weight è on f° is by definition 
a linear form on t° such that 5(h,) (1S$+SS1) are all integers, especially the 
weights A, (1<i<1) such that Ash) nö, are called the fundamental 
dominant weights. The weights 5h i is equal to the total sum of positive 


roots; we denote it by 5, while the ‘total sum of complementary positive roots 
will be denoted by dr. We set further 8x —2 SA (this is not equal to the 


aes 
total sum of positive roots belonging to [¥°,f°]!). To every weight 5 corres- 
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ponds naturally the character o € Hom(T°,C*) such that 5 is the differential . 
of o, since G° is simply-connected. 


4. Finally we shall recall some results of Harish-Chandra [8]: G° con- 
tains N’K°N- as an open set, and the mapping 
(2,9,2) > syz (ce N*,ye Ko,ze N-) 


is an injective holomorphic one of the complex manifold N+ X K° X N- into 
G°; hence we have, in particular, KNN-= {1}. Further, it holds: 


G C NtKON- = N*U. 


Hence we see that GU is an open set of WU and N*U is that of G°; factoring 
by U from the right these sets, we get, using GNU=K (cf. 1) and N*NU 
— {1}, the inclusions: 


Z=G/ECNCG/U—X“. 


We shall denote by j, (resp. j2) the first (resp. the second) inclusion mapping ; 
they are biholomorphic and the composition 7,07, coincides with Borel’s im- 
bedding j of X into X* (cf. [1]), while the mapping logoj,: X>n* is no 
other than Harish-Chandra’s realization of X as a bounded domain in 2 
complex cartesian space n* [8]. Now we show 


Lemma 1. Grj(X) CN+KeN’, and j, is compatible with the actions 
of G. 

Proof. Let g¢@ and t=—g’-a,€X. Then Y=j,(r) modU, and 
so gg =g'jı(z)modU. While gg’==j,(gr) mod U, hence it holds that 
9°9:(2) = j.(gz) mod U. This proves the lemma. 


§2. Canonical factor of automorphy and automorphic forms of type p. 


5. By Lemma 1 in the preceding section, we can write for every ge G 
and ze X as follows: 
9 ji(t) =fi(g-2)J(g,2) modi, 


where jı(ge) and J(g,z) denote the N*-component and the K*-component ' 
of g‘jı(@) respectively. We obtain thus the mapping J of GX Z into Ke 
which has the following properties: 


i) the mapping > J(g,x) is a holomorphic one of X into K° for 
any fixed g € G. 
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ii) J(gg’,x) =J(g,9'2)J (g'z) for every 9,7 € G and zeX. 

ii) J(g,2) is the K*-component of g in N*K°N-, and J(k, z) =k 
for every } € K° and z€ X. 

iv) J(1,2) <1 for every s€ X; we havethereby J(g,2)"—=J(g, gz) 
for every g € Gand ce X. 


Definition 1. The mapping J: GX X— K° introduced above is called 
_ the canonical factor of automorphy with respect to the symmetric bounded 
domain X == G/K, 


Given" ity homomorphism p€ Hom(K°. GL(m,C)), we will now define 
the mapping Jp =poJ: GX X—> GL(m,C) by 


J (9,2) = p(J(g,2)); for ge G,2e X. 


Jp will be called the automorphic factor of type p. From the properties of J, 
we deduce the following: 


i)’ Jp is holomorphic with respect to the variable z€ X. 


ii)’ Tp(gg’,2) =Io(g, 9'2)ITo(g’,x) for g,g' €G and EX. 

ii)’ Jp(k,z)—=p(k) for ke K’ and ze X. 

iv)’ Jp(1,v) 1 for s€ X, and Jp(g,2)*=Jp(g, gr) for gg EG 
and zE Z. 


Let now T be a discrete subgroup of G which satisfies the following two 
conditions : 


(a) The right coset space T\G is compact; what is the same, the quotient 
space T\Y is compact. 


(b) Every element yET different from the identity 1, has no-fixed 
point in X; this implies, as is well known, the quotient space T\X has the 
structure of a complex analytic manifold without singularities. 

We shall assume throughout this paper these two conditions (a) and (b) 
for I’; the quotient manifold T\X will be denoted by Y (the projection of X 
onto FY will be denoted by ¢). Y is an algebraic manifold by a theorem of 
Kodaira [15]. 


“ Definition 2. A holomorphic mapping f of X into C™ is called an 
automorphic form of type p with respect to T, if the following conditions 
are satisfied. 

(yt) = p (J (y£) )f (2), 
for yET and v€ X. : 
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To make clear the meaning of the above definitions, we will now introduce 
the holomorphic vector bundle E,., over Y as follows: We assume henceforth 
that p(Z) = {1} for the finite center Z of G° and define the action of g€ G 
on the product manifold X X C™ by 


go (z,é) = (9°, p(F (9,2) )6) 


for re X and €€C*, and set Ep. as the quotient T\(X X Cr) by these” 
actions. Epos is clearly a complex manifold, with the structure of a holo- 
morphic vector bundle over P—=T\X with the fibre C” and the group GL(m, C). 
Then we see readily that an automorphic form of type p is naturally identified 
with a holomorphic cross section of Epos, and conversely. Thus, the complex 
vector space of all automorphic forms of type p will be denoted by H°(Y, Epo 3). 


6. Following to Bott [5], we recall here the concept of homogeneous 
vector bundles over X*.7 

The connected complex Lie group U=K°-N- being the semidirect 
product of Ke and the normal closed subgroup N- (81,4), every p € Hom(K*, 
GL(m,C)) can be extended naturally to the holomorphic representation of 
U over C™, which we will denote also by p: p€ Hom(U, GL(m,C)). Con- 
versely for every completely reducible holomorphic representation p € Hom(U, 
@L(m,C)), we can show that p(N-) = {1}; so that we may regard ag 
pE Hom(K*, GL(m,C)). Thus, Hom(K°, GL(m,C)) will be identified from 
now on with a subset of Hom(U, GL(m,€)) in this sense. Now, for any 
pE Hom(K*, GL(m,C)), we set E,* as the quotient manifold GX vCr of 
Q? X C™ by U under the actions such that 


uo (9,8) = (gu, p(w) é) 


for g € G°, é€ Cr and uc U. Then E,* has the structure a holomorphic vector 
bundle over X* with the fibre C”; we call-Hp* the homogeneous vector bundle 
over X* with respect to p. In the sequel, we will denote by [g,&]p the element 
of Ep” which is the natural projection of (g,&)€ G° X Cr". It is to be noted 
that G° acts naturally on Æp” from the left as bundle automorphisms; in fact, 
each g’ € G° acts on Ep* by go [g, Elo — [9’9, Elo- 

7. Let us now consider the induced bundle j*#p* over X of E,* by the 
mapping j, then, 7 being compatible with the actions of G, @ act on j*Hp* 
from the left as bundle automorphisms; in particular T act on j*#,*. There- 
fore the quotient manifold TY*E,* is meaningful. It clearly constitutes a 


7 See also [12, Chap. I]. 
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holomorphic vector bundle over Y=T\X with fibre C™. What is now to be 
proved is 


Proposition 1. The vector bundle Ep oy is holomorphically isomorphic to 
Ty*Ep*. 


Proof. The induced bundle 4.*E,* over N* may be regarded to consist of 
all the elements [g,é]p such that ge N*U and € €™. So that, denoting by 
gy* (resp. gu) the N*-component (resp. U-component) of ge N*tU, it corres- 
ponds to such [g,é]p the element (gy+,p(g7)&) € N* X C™ definitely. This 
yields an isomorphism of the bundle j.*#p* onto the trivial bundle N’ X €™ 
over N+ with the fibre C”. From this we infer immediately that the induced 
bundle j*Ep* = j1* (Ja* Ep“) over X is considered, as the set, to consist of 
[g,élo; ge GU and €C™, and that it is isomorphic to the trivial bundle 
X X C™ via the bundle isomorphism: 


[9 éj > (gU,p(gv)E), 


where gy denotes the U-component of ge GU in the sense of the inclusion 
GU CN*U. Now, the action of yET on X XC" via the above bundle 
isomorphism is given by the formula: 


ye (29) = (Y2, p (I (y2) )n) 


for (z,n) EX XC”. In fact, we may write g =gu; JEG, veU and 
(yg od (yg, a)n =J (y, 9 x)J (g e)n (5,ii)) for some n’E N”, and s0 
we have 
p( (yg )o) =e (Y9 T0)) p(T (9, 2) ) 
=p (I (y£) ) Pl); 


therefore we have p((yg)v)=p(J(y,2))-p(go) for z= g: To= g: to. 
Hence, it follows that T\j*- E,* = Ep o y via the isomorphism: j*E p" = X X Cm. 
Our proposition is thus proved. 

As the special cases of Proposition 1, we shall now concern ourselves with 
the tangent bundle @y and the canonical bundle Ky of Y (®y will be denoted 
simply by ®). Denote by ®* and K* the tangent bundle and the canonical 
bundle of X* respectively. Then j*@* (resp. j*K*) gives clearly the tangent 
bundle (resp. the canonical bundle) of X; this implies that Tyj*e*=® and 
that T\y*- K* = Ky. 

. On the other hand, if we denote by (Adx, n*) the adjoint representation 
of K over n* (this is meaningful since [f,n*] C n*; see 81,2), then @* is 
the homogeneous vector bundle over X* with respect to Adr: ©" = Ey" 
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(cf. [5]). Alternatively it holds that K” = By,-ı*, where 8g € Hom(K®,C*) 
is the character whose differential öx is the sum of all positive complementary. 
roots (ef. [5]). Hence, from Proposition 1 one concludes: 


COROLLARY. @ = E haros, and Ky = Ey ter 


83. Fundamental bundle diagram. 


8. We recall that T is a fixed maximal toral subgroup of K (also of G*) ; 
for this T we now introduce the following manifolds: 


Ar G/T, Yr=-TXr=T\G/T, Kt G/T, 


The last manifold Xr“, the so-called flag manifold of G*, is represented as the 
complex coset space G°/U,, where U is a maximal solvable subgroup of G° 
such that U D U, D T° (ef. §1,2). If we define the mapping jr of Xr 
into Xr” by 

jr(gT) =9Uo  gEG, 


then jr is one-to-one and homeomorphie by G N Us=—=T (81,2). Therefore, 
Xr has the G-invariant structure induced by jr from that of the open sub- 
manifold jr(Xr) of Xr”. Further, T acting on Xr such that every yET 
(y1) has no fixed point, Yp is also a complex manifold; the projection of 
Xr onto Yr will be denoted by pr. 

Now we shall consider three mappings: 


Oo: Yr>}, 
r: Xp X, 
$: Xr" > X, 


which are defined respectively by setting w(TgT) =TgK (g€ G), r(gT) = gK 
(gE G) and ¢(gT) =gK (g€ G*). Then, they are surjective and clearly 
constitute the following commutative diagram. 


er jr 
Yr e Xr —X7r 


p J 
Y «—— X —— J“ 
We set moreover M — K/T, then M is the flag manifold of K and is also 
identified with the complex coset space K°/U,; where U, is a maximal solvable 


subgroup of K° such that U, D U, D T° (81,2). The holomorphic mapping 
$: Xp*-—> X* clearly makes a holomorphic fibre bundle X7*(X*, M, K°, 6) 


6 
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with the standard fibre M and the structure group K°. Therefore the mapping 
x: Xr— X also becomes a holomorphic fibre bundle with fibre M as the induced 
bundle of the bundle Xp*(X*, M, K°, $) by j; jr being the bundle mapping of 
the former into the latter. Finally, by the commutativity wodr—= 60, 
we infer easily that w: Yr—Y constitutes naturally the holomorphic fibre 
bundle Fr(Y, M, K”, w), where Yr is an algebraic manifold by a theorem of 
. Borel (ef. [10, p. 140]). It is now to be noted that the bundle Xr(X,M, K°, x) 
is holomorphically trivial, since X is a contractible Stein manifold. In fact, 
it holds: 


Lemma 2. The complex manifold Xr can be identified with X X M by 
the mapping: 
9T> (9K, I (g, %0) U1) 


for ge G; under this identification, the left translation by ge@ on Xr is 
transferred to the action on X X M such that 


go (a, 2) = (g `z, J (g,2)z) 
for c€ X and z€ M. . 

Proof. First, our mapping is surjective, since J (k, £o) =k for any ke K 
(§2,iti)). Suppose that (gK,J(g,2)U:) = (9’K,J(9’,%0)Ui) (g EG), 
then g’ == gk for some k€ K, and so J(g’,2)) =J(g,%)%. This implies that 
ke UNK =T (cf. §1,2) and that g'€ gT. Hence our mapping is injec- 
tive. Finally it is holomorphic since GU, is an open set of G and GU,/U, = Xr 
as the complex manifolds. The rule for actions of Ton X X M is obvious. 
This furnishes the proof. 

Furthermore we define here the canonical (holomorphic) injections of 
the complex manifold M into the complex manifolds Yr, Xp and Xz“ 
respectively ; 1: Mr—> Yr, ur: Mr>Xr and w: M> Xo" as follows: 

ı(kT)=TkT, (ke XK), 
(kT) —=kT, (KEK), 
w(kT) == kT, (ke K). 
Then we have obviously 


t == pr O up, ty = Jr ° tp. 


§4 Line bundles over Y7. 


9. The present Section 4 will be devoted to the study of the group 
H'(Yr,D*) of all holomorphic line bundles over Fr; for this purpose, we 
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shall first determine the subgroup % of H'(Y,0*) which consists of line 
bundles along the fibres in the bundle Yr(Y,M,K°,w). In what follows, 
we recall that both G° and G* are simply-connected (cf. §1). ; 

First we consider the holomorphic line bundles over Xy” (resp. over M). 
Now recall that U, (resp. U1) is the semidirect product of T° and its derived 
(normal) subgroup (cf. 81,2); hence we can identify: 


Hom (T°, C*) — Hom (Uo, C*) = Hom (U, €*), 


in a similar way to the case of $2,6. Therefore every o€ Hom (T°, C*) 
will- define the homogeneous line bundle Fe” over Zy*—=G°/U, (resp. F,M 
over M = K°/U,=:U/U,). In fact F,” (resp. Fo™) is, by definition, the 
quotient of Ge C (resp. K° X C) under the actions of U, (resp. U1) such 
that 

uo (g, é) = (gu™,o(u)£) 

(resp. uo (k, é) = (ku, o(u)é)) 


for (g,é)€G°XC and u€ U, (resp. for (k,E)EK°XC and uc U); we 
thus write F,“ = G° X yC (resp. Fo@ =K° Xy,€). Moreover, the element 
of F,” containing (g,é) (resp. the element of F,™ containing (k, ¢)) will be 
denoted by [9,&]r (resp. [%,é]o). We have then clearly 


WR == Fo, x 


The mapping o— F," gives rise to an isomorphism of Hom(T°,C*) onto 
H*(X*,O*) since G° is simply-connected [12, Theorem 1]; while > F,M 
is a homomorphism of Hom(Z*,C*) into H*(M,0*) whose kernel consists 
of o such that o is extendable to a character o € Hom(K°,C*) [12, Lemma 3]. 
Further we want to show the 


Lemma 3. The following exact sequence of abelian groups holds: 
0— Hom (K°, C*) > Hom (T°, C*) > H (M, O*) > 0. 


Proof. The proof is quite similar to that of Theorem 1 in [12]; however 
we state it here for the completeness sake. Both T and T! (== 1-dimensional 
real torus) being the maximal compact subgroups of T° and C* respec- 
tively, we infer easily that Hom (T°, C*) = Hom (T, T+), while Hom (T, T*) 
= H'(T, Z) as was shown in [4, 810]. We see thus Hom (T°, C*) — H“(T, Z). 
On the other hand, in the principal bundle K (M, T), the transgression + will 
clearly map H*(7,Z) onto H?(M,Z) since the transgression: H*(T,Z) 
> H?(X7*,Z) is bijective (cf. [4]) and the restriction map „*: H?(X7%,Z) 
—> H? (M, Z) is surjective. Further, the first Betti number of M vanishing, 
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the characteristic homomorphism c yields an isomorphism of H*(M,*) 
onto H? (M,Z) (= H?,,(M,Z)). As was already shown in [4, Theorem 10.3], 
it holds the commutative diagram : 


Hom (Te, C*)—— H! (M, D*) 


(H 


. 


H+(T,Z) — ,.8:(11,9%). 
Hene, the original homomorphism must be surjective; this proves the lemma. 
Now we define two subgroups Ir and Bx of Hom (T°, C*) by setting: 
Er = {A€ Hom (T°, C*)|(A,&) =0 for all &E g °). 
Gy = {n€ Hom. (T°, C*) | (p, ay) = 0 for all a; ¢ 3}. 


As is readily observed, it holds that Xr = Hom (K°,C*) via the restriction 

mapping in Lemma 3 (we identify these two groups!) and that Hom (T°, C*) 
-is the direct product of Xr and Ix; we can thus write every o € Hom (T°, C*) 

as o= (A, p), AE Bx, pE By. So that, a—>F,M yields the isomorphism: 


Gu H'(M,D®). 
From these arguments, it follows now the corollary: 


CoroLLarY. We have the commutative diagram of abelian groups (the 
extensions are splittable) : 


0 > Ss —~»Hom(T?,C*) —> Bu —0 
$* ur 
0 H (X*, 0%) —— H! (Xr, O*) —— H (M, O*) > 0, 
where the vertical mappings are all isomorphisms. 


10. On the other hand, Œ acts as bundle automorphisms on the induced 
bundle jr*F,* over Xr; therefore we can define the holomorphic line bundle 
Fo over Yr as the quotient manifold of jp*F,* by T (C @): 


Fo= Dirt ou 
We see then readily that 
Fo = FM, 


Define now the subgroup Xu of H*(Y7,*) by setting; 


e A is the simple roots system of [¥*, f°]; see $1, 2. 
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Har = (Fy | we Buh. 
Then the restriction mapping ı*: F,—> Ff gives the isomorphism by Corollary 
of Lemma 3: 
Au = Ht(M,O*). 
. We shall now prove: 
Proposrrion 2. It holds that 
H!(Yr, 0*) = w*- H(Y,0*) Oy, 


where Q denotes the tensor product of line bundles, and w*H?(Y,D*) N Hu 
contains only the trivial bundle. 


(This proposition is not needed for the subsequent sections, but it will 
be necessary in the forthcoming paper.) 


Proof. First suppose that F, € w*H*(Y,©*) N Mu, then .*-F,— FM 
is clearly the trivial bundle; hence a= 1 by Cor. of Lemma 3. Therefore Fy 
is also trivial. 

Next we shall study the second integral cohomology group H*(Yr,Z) of 
Yr; for this sake we consider the following diagram of bundles: 


Or 
IG—[j7 


w 
8 | 
a 
where wr: T\G—>Yr is given by we(Tg)—=TgT and ox:T\G>Y by 
wx(lg) =TgK respectively ; the latter clearly makes the differentiable prin- 
cipal K-bundle over Y with the bundle Yr(Y,M,K,m) as its associated one. 
While, K/T = M being the flag manifold, we can apply a result of A. Borel 
[2, Cor. de Proposition 18.3] to our case. In fact, from this and from that 
(M,Z) = 0, we infer that 
H:(Yn,Z) = w*H?(Y,Z) + c(H#x), 
where c(a) denotes the subgroup of H?(¥y,Z) consisting of the Chern 
classes c(F,) of line bundles F,€ Hy: 
c( Hu) = {c( Fz) | Fh E€ Hu). 

We note here that H?(M,Z) consists of all the Chern classes of 

FM € H*(M,O*) : H*(M,Z) = {(c(Fu¥) | n€ Xu} 
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(ef. [4], [12]), and that c(i) is isomorphic via ı* to H?(M;Z), since 
th, == F,4, Denote now by H*,,(¥r,Z) (resp. H*,,(¥,Z)) the subgroup 
of H?(Yr,Z) (resp. H?(Y,Z)) consisting of all 2-cohomology classes of type 
(1.1); that is to say, the inverse image of H*,,(¥Y,C) (resp. H*,,(Y,C)) 
by the natural homomorphism H?(Y,Z)>H?(Y,C) (resp. H°(Y,Z) 
—H°(Y,C)), where H*,,(¥r,C) (resp. H*,,(¥,€)) denotes all the co- 
‘homology classes containing closed 2-forms of type (1.1). 
Then we see readily that 


H*, (Yn, Z) kr w*H*, ,(¥,Z) + c( Bx), 


by the fact that both w and ı are holomorphic. Therefore, the theorem of 
Lefschetz-Hodge [9, p. 125] implies that 


¢(H*(Yr,*)) =¢(w*H*(Y,O*)) + (Hu); 
c denoting the characteristic homomorphisms. Hence we see that 
H} (Yr, 0*) =w*H!(Y,0*) O Aar 


modulo the Picard variety P of Yr. Here, by the Picard variety P of Yr, 
we understand as a subgroup of H?(Y7,0*) consisting of certain line bundles 
associated with characters of the fundamental group m(Yr); «i(Yr) is 
identified with T since m(Xr) =0. Let ÊE P be now associated with 
o€ Hom(T,C*): E,=Xr7rXrC, where the actions of T on C is those of 
oe(T). We can correspondingly define a line bundle E, over Y by the same 
o: E5,=XXrC°; then we have clearly fy =-w*-H,. Hence we see that 
P C w*- H*(Y,0*) ; in other words, it holds that 


EH? (Yr, D*) = w* HY, O*) @ Hy. 
This completes the proof of our proposition. 


11. In the sequel, we shall confine ourselves to the line bundles of the 
form Fo; o= (à p) (AE Bx, pE Bu). Now we put 


Fy p= 0*H, O Fy, 


then the commutatively of the fundamental bundle diagram ($3) implies that 
Fy, = w*E. s, while Fo =F 8 F,; hence we see 


Foo Fra 
For the later use, we mention here the following lemma. 


° Xp Xe C denotes the quotient manifold of Xr X C by the actions of T: yo (@, €) 
= (yo,o(y)é) for vel, HE Xr XC. X XrC is also understood in a similar way. 
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Lemma 4. The holomorphic line bundle Fo is identifed with 
IV(X X FM); 
the action of T on X X F,M is now given by the formula: 
yo (z, [k Ju) = (y2, [I (y, ) A(T (2%) Ela), 
for yeT, zeX and [k, é] E€ F,# (cf. 84,9). 


Proof. By Lemma 2, Xr=X X M. The bundle jr*F,* is also identified 
with X X F,M so that the diagram 


jr*Fo* —> X X F,™ 








Xr XZxM 


is commutative. In fact, jr*F,* can be regarded as the subset of Fa” con- 
sisting of [g,é]o; g€ GUo, EEC. Thus, denoting by gx» the K-component 
of g in the sense of the inclusion GU, C GU C N*K°N-, we can define the 
bundle isomorphism of jp*F,* onto X X F,M by 


[9 éle > (9Uo, [gue A(gxe)€]u)- 
We see, in fact, that for any ve Uo, 


(gu) xem ((gu)u)ze— (gu U) Ke = Jxe' UE. 


On the other hand, we can show that (yg)xe—J(y,2) ‘gee (£= gUo) as in 
the proof of Proposition 1 (§2). Now it is easy to verify that, via the above 
bundle isomorphism, the actions of T on jr*F,* is given by the formula 
mentioned in our lemma. 


COROLLARY. The canonical bundle Kr of Yr is gwen by Kp— Faa 
= IYr Font, and identified with TX X Fa). 


Proof. We know that the canonical bundle of Xr* is the dual line bundle 
of Fy* (see, for instance, [5]); hence Fs is isomorphic to Ky*. The last 
part is a special case of Lemma 4. 


§5. Chern classes and positive line bundles. 


12. In this section, we shall discuss the Chern classes of the vector 
bundle Epo; and the line bundle Fe. For this sake, we shall employ an 
analogue of Borel-Hirzebruch’s method in dealing with the Chern classes of 
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the vector bundle Æp” over X* and of the line bundle F,* over X7* respec- 
tively (see [4]; in particular, Theorem 10.3). 

Let us now consider the differentiable principal K-bundle over F: 
I\G(Y,K, wx), where K acts on T\G from the right, and wx denotes the 
natural projection of r\G onto Y=T\G/K. Alternatively we have the 
differentiable principal T-bundle over Yr: I\G (Yr, T, wr), in a similar way. 

"We obtain thus the triangle of bundles, which was already utilized in §4 
(ef. the proof of Proposition 2) : 
Or 

I\G ————___—> Yr 


For every p€ Hom(K°, GL(m,C)) (resp. o € Hom(T7°,C*)), we will denote 
by px (resp. by or) the restriction of p to K (resp. the restriction of ø to T). 
We may then assume that pr(K) C U(m) and or(T) C U(1) =T"; so that 
we have the differentiable U(m)-bundle B, over Y as the bundle associated 
to the bundle T\G(Y,K,wx) by px, and the differentiable U (1)-bundle Be 
over Yr as the associated one to the bundle '\@(¥z, T, wr) by or respectively. 
Furthermore we will denote the vector bundle associated to the principal 
bundle Bp (resp. to Bo) with the fibre C™ (resp. with the fibre C) by the 
same letter Bp (resp. Bo). 


PROPOSITION 3. i)? Epos ts differentiably isomorphic to Bp; therefore 
(Epos) = (Bp) (SiS m). : 


ii) Fo ts differentiably isomorphic to Bo, and so c(F,) = c(Bo). 


Proof. i) We will define the differentiable mapping y of EX C™ onto 
X X C” such that 
Yo (9,€) = (9 To p(J (9, 20) JE), 


for (g,é) € @ X C”. While, the bundle Bp is the quotient of EX C™ with 
respect to the equivalence relation : 


(9, é) ~ (y9k7, px (k)E) 


for yeT and kE K, and alternatively Epez is the quotient of X X Cr with 
respect to the equivalence relation indicated in §2. The mapping y being 


1° This is due to Y. Matsushima and S. Murakami [16: Part II, Prop. 4.1]. 
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clearly compatible with these as relations, it induces the bundle 
isomorphism of Bp onto Epos. 
ii) The bundle B, is the quotient of Œ X C with ren to the equiva- 
lence relation: 
(9,€) ~ (ygt, or (#)£), 


for (g,£)EGXC, yET and tET. While Fe= Fpa is the quotient of. 
X X F,™ with respect to the one given in Lemma 4 ($4). Define now the 
mapping y of G XC onto X X F,” by putting: E 


yo (9 £) fe (9° To [I (g, Zo), A(T (9, to) En), 


for (gE)EGXC. Then we can readily verify that y is compatible with these 
equivalence relations. Hence y will define the bundle isomorphism of B, 
onto Fe. Our proposition is now proved. 

Owing to this proposition, we may be hereafter concerned with the Chern 
classes of Bp (resp. Bo), instead of those of Epog (resp. Fo). 


18. Recall now that Hom(7°,C*), or the lattice of weights can be 
identified with H+(T,Z) under the correspondence ¢—>6/2rV—1 (see, for 
detail, [4,§10]) since G* is simply-connected. We denote by r” (resp. by r) 
the transgression of the bundle G*(X*, T, ġr) (resp. T\G (Yr, T, wr)). For 
any given p€ Hom(K°, @L(m,C)) we also denote by é1,: - +, õm the weights 
of p. Then a result of Borel-Hirzebruch [4, Theorem 10.3] implies in our 
cases the following: 

Lemma 5. i) For any character o€ Hom(T°, C*), it holds that 

(Be) =—7(6/2r V—1), ec (Br) =— 1" (6/22rV —1). 

ii) The total Chern classes c(Bp), ¢(Bp*) of the bundles Bp, Bp* are 

given respectively by 


$*c(Bp) -j (1—r(&/2rV—1)) € H*(¥,2), 
w*c(Bp*) =I (1 —+*(&/2nV—1)) € H*(X*,Z). 


We shall now take out closed differential forms which represent the real 
classes of the Chern classes appeared above: For «€ Hom(T°,C*) we set 


1 (la, 9]) 





en 


for z,y€ g°, where & is regarded as a linear form on g° by putting 
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5(h-+ È Cala) = 5(h) (RET, cc€C) 


for the Cartan decomposition of g° (cf. §1). Then we obtain an alternating 
bilinear form 70 on g? which is invariant under Ad T°. The restriction 5 | t 
being purely-imaginary valued, the restriction 7, = ño | g (resp. qo” == fo | g”) 
is an alternating real valued bilinear form on g (resp. on g*) which is invariant 
under AdT. Moreover we see that 7. is a 2-cocycle in the sense of 
relative cohomology of g°modt*. This implies that yo (resp. yo*) induces 
a G-invariant (resp. G*-invariant) closed 2-form on G/T=Xr (resp. on 
G*/T — %r*); these forms shall be denoted by the same letters yo, no% for 
brevity. Further yo naturally defines the closed 2-form 7, on T\Xr—= Yr. 
If o= A€ %x in particular, we see similarly that m (resp. m”) represents a 
G-invariant (resp. @*-invariant) closed 2-form on X (resp. on X*) and that 
m naturally induces the closed 2-form jo on I\X =F. (We often write as 
ne =1(Bo*), Jo =n (Bo) ete.) 

Next, for p€ Hom(K°*,@L(m,C€)) with the weights 6° * ',öm, we 
now introduce the alternating 2p-form jp® on g° by 


(8) as RN eee, 
a ee A u derem); 


Then, 7p” is a 2p-cocycle not only in the sense of relative cohomology of 
`g? mod t°, but also in the sense of relative cohomology of g° mod. This will 
‘be readily verified from the following fact: if we denote by p, the representation 
of K° over the alternating tensors of degree p induced by p, the traces of linear 
transformations belonging to pp([f*,{*]) vanish. Let ñp® (resp. yp*® now 
denote the restriction of jp to g (resp g*), then we have 


Om 5 Nass 
m = 2 HH 701,5 


np" ae ey Nee Any 3 
1n 


moreover np) (resp. np*® gives rise to a G-invariant (resp. G*-invariant) 
closed 2p-form on X (resp. on X*). yp) also induces the closed 2p-form 
yo” on Y. They shall be often denoted respectively by np*?) == P (Bp) and 
ip? = P (Bp). 

Definition 3. The closed 2-form (Bo) (resp. 7(By*), 7(Bo), n(Bı)) 
is called the canonical Chern form of the bundle Bo” over Xy” (resp. By* 
over X*, Bo over Yr, By over Y). While, „P(B,*) (resp. 4°(Bp)) is called 
the p-th canonical Chern form of the bundle B,* (resp. Bp). i 


PROPOSITION 4. The canonical Chern forms of these U(1)-bundles are 
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all of type (1.1) in the respective complex manifolds, and belong to the real 
Chern classes of the respective U(1)-bundles. 


From this proposition, combining with Lemma 5, we can deduce imme- 
diately the following: 


COROLLARY. The form (Bp) (resp. P(B,*)) (1S pm) is of type 
(p,p), and belongs to the p-th real Chern class of Bp (resp. of Bp*). 2 

14. Now, we shall proceed to the proof of Proposition 41: We denote 
by r the transgression in the principal bundle G(Xr,T,rr), then we can 
infer easily that 7’ ==gr*o7 in the next diagram. 


, 


E 
H1(T, R) ———_————>> H’ (Xz, R) 
pr” 
z 
H? (Fr, R). 


While v (&/2rV—1) contains the 2-cocycle (closed 2-form) —no, as is 
immediately known from the definition of the transgression. Hence we infer 
that r (5/7 V—1) contains the closed 2-form —%, which is naturally induced 
from — yo on Fr since 7’ = pr* or. This proves the last part of our proposi- 
tion for no =7(Bo). j 

Next we want to show that ņ, is of type (1.1): Denote now by wa (resp. 
wa) the left-invariant holomorphic 1-form on G° (for any root &), whose 
restriction to g° is annihilated by 1°, wa (€a) = 1 (resp. o’a(¢a) = V—1) and 
wa(eg) = 0 (resp. w’a(eg) = 0) for 8544. Then the exterior product wa A w-a 
(resp. o'a A o-a) for any positive root & is invariant under Ad T°. Hence 
the restriction of wa A w-a (resp. w'a A 'w-a) to G yields the G-invariant (closed) 
2-form on G/T = Xr, which we will denote by the same symbol we A w-a (resp. 
w'a A wa). We shall show that we A\wo (re8p. w'a A w-a) is of type (1.1) 
in the complex manifold Xr. Recall now that the G-invariant complex struc- 
ture of Xr is induced from that of the open set GU, of @° such that jr(Är) 
= GU,/U,C G°/Up»p = Xr* (cf. 83,8). While, the tangent space of Xr” 
at z,” (resp. the tangent space of Xr at x.) is naturally identified with p+ m 
(resp. with p+ V—1-m) (cf. §1,2); under these identifications jr induces 
the linear mapping 5’r on these tangent spaces such that 





Fr: e+ V—l-yoaty (for zE p, y Em). 


11 As to the bundles B,* and B,", Proposition 4 is already known (cf. Theorem 10.3 
in [4]); hence the proofs shall be omitted for them. 
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Further we see that the (complex) tangent vectors at z,* which annihilate 
_ all local anti-holomorphic functions of z,* (resp. all local holomorphic func- 
tions at z,“) are considered, under the above identifications, to span to* 
(resp. no). Hence the (complex) tangent vectors at z, of Xp which anni- 
“hilate all local anti-holomorphic functions at z, (resp, all local holomorphic 
functions at z,) are considered to span (not NE) + n (resp. (no NE) + nt). 

`: * Oh the other hand, we have 


° 


(wa A ua) (6p, 8y) 0 unless f =— f= +å 


l (wa A aa) (Ca, 8-a) == $. 
. This shows that the left-invariant 2-form 7, on G° is given by 


I S (6 aon A a 
RELA T a>o 

=l 5 o o 
4, 5(ha) and ñe(ep, 6y) = 0 unless B=—y—+ä 
(cf. the definition of Jo in 18). From this we obtain the formula: 


n= GUE Gam Aea — E BBa A a); 





SINCE Ño (Eu, E-a) = V 


‚where we note that wa (resp. w’g) is the form not defined all over Xr but 
is defined in a suitable neighbourhood of x, as a holomorphic 1-form, for which 
w_a (resp. w’_g) represents there the form conjugate to wa (resp. to o’g). Thus, 
no is a G-invariant 2-form of type (1.1). While, the form ĝo has the same 
local expression as ņo; this proves our proposition for jc==7(B,). 
Moreover we see that yo is the imaginary part of the hermitian form 


HOE (8,4) 0e°wa— I (6, f)o’g0o' 5}, 
ta €k* Og Ent 


where we°wa (resp. og’) denotes the G-invariant symmetric differential 
form on Xr induced from the @°-invariant form on G° which is the symmetric 
product of wa and oo (resp. the symmetric product of w’g and wg). The 
form wa ° wa (Tesp. wg O wg) coincides, as is wa A wa (resp. w’g A wg), with 
the symmetric product of the holomorphic 1-form wa and its conjugate wa 
(resp. wp and w’_g) in a neighbourhood of z, in Xz. The explicit expression 
of n, obtained above now yields the 


Proposition 5. The line bundle Fe Fp is positive in the sense of 
Kodaira [14], if (6,4) <0 for all complementary positive roots & and 
(ha) > 0 for allae 3 (while Fat is positive if (&,%) >0 for all simple 
roots & [4]). 
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15. In the case o= A€ Hx, the above arguments go well for the line 
bundle #,., and its canonical Chern form m (more easily than for ĝe) and 
the detailed proof will be omitted. In fact, for eg€ n*, the restriction of 
a'g A œg to G will be readily verified to yield the G-invariant closed 2-form 
on G/K = X, which is also of type (1.1). This form is to be also denoted. 
by the same symbol ws A wg; then we can regard it, in a suitable neighbour- : . 
hood of To as the exterior product of the holomorphic 1-form o’g and its, _ 
complex conjugate w’_g. Then we obtain immediately the formula: a 


v—i1 Say , 
KS 5 È (A, B)o’p A og. 
6g Ent 


Further we see that 7, belongs to the real Chern class of B, in a similar way 
to the case for ĵo and By. Hence j 


Provosrtion 6. The line bundle Enez over Y is positive, if (A,%) <0 
for all u ¢ 3 (while Ey is positive, if (A, &) >0 for all &g ð [4]). 
§6. Generalization of Hirzebruch’s proportionality principle. 

16. Let 7 denote an alternating 2p-form on g° which represents a 2p- 


cocycle in thet sense of the relative cohomology on g°modf? (ISp=N); ` . 


we assume further that 7 is real valued on g*. For such a ñ, we denote by »*’ 


(resp. by 7) the restriction of 7 to g* (resp. to 9; then both 7* and n ard 
real valued; in fact we see 


‘i) lu + +, Uap) lt + t, Vop)'—=0, if there exist elements of f 
among u (11 2p) and among v; (LSiS?2p) respectively. 
E) Wty: > stia) = (DVT ty: + «5 VET tap) for wem 
(1515 2p). 
Hence 7* (resp. 7) represents a left invariant closed 2p-form on X*— G*/K 
(resp. on X=@/K). Furthermore n induces naturally the closed 2p-form 
non Y==T\Y. Recall now that y“ is necessarily of type (p,p) (cf. [4])”; 
7 is also of type (p,p) as is readily seen (compare with § 5,15). Hence 7 is 
of type (p, p). . 


Suppose now that »,*,- - *,ns® are G-invariant forms on X* such that 


m” is of type (pop) (ISiSs) and Zo-N. We consider the corres- 


ponding G-invariant forms n,° ' -,7 on X and further the closed forms 
95°" ‘5. over Y. Then the exterior product m A>- Nq” is a G*- 
invariant closed form of type (N,N) on X*, and ĝa A- + An. is a closed 


** This can be also directly verified. 
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form of type (N,N) on Y. Furthermore we take another set of @*-invariant 
forms {,*,: - -,&* on X* with the analogous properties and the corresponding 
forms b, : es on F. Then, since &* AA &* is also a G*-invariant 
form of type (N,N) on X*, there exists a real constant a such that 


bt As A Gt amt A+++ N gt (on Ze). 
„By the properties i), ii), we have 
iA A&G SamA+ Am (mL). 
Hence 
EA AGENT). 
17. Now let p: * ',ps be a finite number of holomorphic represen- 


tations of K°. We consider the corresponding bundles Bp,*,- © -, Bp,* over X*, 
and Bep’ "Bo, over Y. Let m* (resp. m) (1SiSs) denote the p;-th 


canonical Chern forms of Bp,” (resp. of Bp,), assuming that $ p; =N. Then 
4=1 


we have seen in §5 that % (1SiSs) are obtained from * (1StSs) in 
the process described above. 

By ax» (resp. ay) denotes the generator of the infinite cyclic group 
HPN (X*,Z) (resp. H?%(Y,Z)) which is determined by the natural orientation 
of the complex manifold X* (resp. Y). Then we can put 


Cp (Bp) * + Cp, (Bp,*) == cze (pi; pi) "ax 
Cp, (Bp,)* * * Cp, (Bp,) = Cy (Pi; pi) "ar; f 


where cxx(745 ps), er(pisp) €Z. The numbers cxs(pi;p) (resp. Cy (Pi; p)) 
are called Chern numbers** of the bundles B,,* (resp. Bp,) (1Si&8)). 
We want now to show the following: 


Lemma 6.  cy(pi3p:) =x(Y)-cx«(pey ps), where x(¥) denotes the 
arithmetic genus of Y. 


Proof. It is sufficient to show that there is a rational constant b not 
depending on the choices of prs and pps such that 


Cy (Pi; pr) =b: cxe(p15 pi). 
In fact, if this is the case, we have in particular 


cr (pı; Adz) =b- cxx(py3 Adz) 
(all p; are Adx), while Riemann-Roch-Hirzebruch’s theorem implies that the 


28 When all the Pı (lta) coincide with (Ad,,n*), these are Chern numbers 
of X* (resp. of Y) in the usual sense (cf. [9; 10]). 
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arithmetic genera x(¥) and x(X*) are the same linear combinations over Q 
of these Chern numbers cy(m;Adx) and of cx-(p;;Adx) respectively. Hence 
we see x(¥Y) =b: x(X") =b, by using x(X*) =1 (cf. [4]). Take now 
another set of holomorphic representations ¢:,---,¢: of K°, and natural 


numbers qı’ * ‘,g, such that 20-8; we put 

ox(4;585) =a: on(P;p) (aE Q). 
From this, it follows that The (Be) = a TPP Ba") and that Te (B;,) 
al (Bp,). Hence we have 


Cy (Q; pi) = a` Cy (P45 pi). 


Thus we see that cy(1%43:)/cx«(p13 p14) =b does not depend on the choices 
of ps and p’s. Our lemma is now proved. 

Now, for any p€ Hom(K°, GL(m,C)) we consider the Euler charac- 
teristics x(Y, Epos) and x(X*, Ep*) : 


x(¥, Ep os) =) (—1)¢dime H1(Y, Epos), 
q9 


N 
x(X*, Ep*) =2 (— 1)! dime H1 (X*, Ep”). 


Then, the generalized Riemann-Roch theorem of Hirzebruch [9], combined 
with Proposition 3, implies that x(Y, Epos) and x(X*,E,*) are the same 
linear combinations of the Chern numbers cr(p;p) and crs(p;; p) respec- 
tively, where pře coincide with p or with Adz. Therefore, from Lemma 6, we 
can deduce the following generalization of Hirzebruch’s-results (see [10 ; Satz 1 
and Satz 4] and also Cor. of Proposition 1). 


THEOREM 1. For any p€ Hom(K°, GL(m,C)), tt holds 
x(Y, Epos) =x (Y) x (X*, Ep”). 


Note that x(X*, Ep”) is known by the theorem of Bott (cf. §7, Theorem 
Bı), while x(Y) is computable if we know the total volume of Y with respect 
to a certain invariant metric of X, say the Bergmann’s metric. In fact, when 
X is irreducible, Hirzebruch [11] showed the formula: 

II (3,4) 
x(¥) = (— ¿)"-=— (F) 
= (8x, x)" Í 


where & runs through all the complementary positive roots, a denotes the 
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unique complementary simple root and v(¥) the total volume of Y with 
respect to the Bergmann’s metric of X. 


87. Vanishing theorems for the cohomology groups H«(Y, Epez). 


18. First we shall resume Bott’s main results concerning the induced 
representations with respect to homogeneous vector bundles [5]. 
Suppose that p€ Hom(K°,GL(m,C)) is an irreducible representation ; 
..for this we consider the homogeneous vector-bundle Hp“ over Xe and the 
cohomology groups H(X", Ep*) (OS qN). The action of ge Ge on Ep” 
as bundle- automorphism now induces the linear automorphism on the C- 
‚module He(X“,E,*); which we will write p@(g). The representation 
(p@, Ha(X*,E,*)) of G° thus obtained is, by definition, the q-th induced 
representation of p. Let o be the highest weight of p, then the induced repre- 
sentations p® (0=q¢=N) are determined only by ø: 


Taxor B,. If there exists a root & such that (è+ 43,4) =0, then 
all pd (0S q SN) are the 0-representations (i.e. H*(X*, E,*) =0). Other- 
wise, there is one and only one non-zero induced representation p© which is 
irreducible and its ‚highest weight & is given by 


ë "+3 = e(è +48), 


where e is the element of Weyl group which is the product of g-reflections 
with respect to. the simple root planes 4=0 and it is uniquely defined by 
the condition (8 +48, a) >0 Sisi). 

Alternatively let «€ Hom(T°,C*) —Hom(Ui,€*) and consider the 
homogeneous line bundle F,” over the manifold M—K/T—K°/U, (for the 
precise definition of F,™, see 84,9). Ke acts on F,™ as bundle automor- 

‘phisms and so it induces the representation o(® of Ke over the s-dimensional 
cohomology group H! (M, F”) (1&8 & n = dime M) ; o® is the s-th induced 
representation of o. We write now as $=A+4; À, a) =0 for all mE g 
and (à, &j) —0 for all a¢ 3. . 


THEorEM B,. If there exists a root & of [€°,f°] such that (¢+ 35, a) 
=0, or what is the same, (E+ 4sm å a) = 0, then all o® (1Ss=Zn) are the 
O-representations. While, if there is no such a root, o) are 0-representations 
except for one s; and the remaining representation (o®, H*(M, FM )) fs an 
irreducible one with the highest weight à + K, W being a dominant weight of 
[f°, te] defined by 


b+ u= ed (i+ 31), 
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where € is the element of Weyl group of [f°,%°] which is the product of. s- 
reflections with respect to the simple root planes &=—=0 (&€ 3), and it is ` 
uniquely determined by the condition (R +-48u,&) >0 for all ned. 


The case 0 in this theorem was first discussed by Borel-Weil [3]. 

19. Let p be an irreducible holomorphic representation of K over G” 
with the highest weight 5; for & we will now define A€ Gx and pE My as * 
in 84: l 

=i +i; à= D phy i= D piy 
ats aye ; 
Then our vanishing theorems with respect to Hp., are formulated as follows: > 
THEOREM 2. i) Suppose that 
ers «) >0 
for all complementary positive roots g. Then 
HıY,E,.,) == 0 for allg<N. 
ii) Suppose that 
(+8,4) <0 
for all complementary positive roots &. Then 
H@(Y,Ep.z) —0 for all g>0. 

On the other hand, from Bott’s theorem (Theorem B,) we infer easily 
the following: In the case i), He(X*, E,*) <0 for all g>0 and the 0-th 
induced representation p® (=p) has the highest weight 6, while in the case 
ii), H(X“, Ep”) —=0 for all g < N and the N-th induced representation p™) 
has the highest weight &' — $, (6 denotes the highest weight of the contra- 
gredient representation of p). Thus, combining Theorem 2 with Theorem 1, 
we can compute the dimensions of the remaining cohomology groups in the 
respective cases: 

COROLLARY. In the case i) we have 

dime HN (Y, Epos) — (—1)%x(¥) deg (ë). 
While, in the case ii) we have 


dime H°(Y, Ep.) = (—1)%x(¥) deg(é’ —&). 


For the proof of Theorem 2, we need Kodaira’s vanishing theorem (cf. 
[14], and also [9, p. 139]) and the spectral sequence arguments with respect 
to the projection w: Yp—>Y. We shall prove in the next section the 


7 
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Proposition %. Denoting by w@(F,) the s-dimensional image sheaf \* 

of the sheaf Fo with respect to w, st holds that 

oy () (Fo) = Ew oJ 
as (analytic) sheaves on Y, where o*) is the holomorphic representation of K° 
over the representation module H*(M,F,™) induced by & in the sense of 
Bott (cf. Theorem B3). 

We know that o@ (0<s<n==dimc M) are zero representations except 
for at most one value of s (cf. Theorem B,). It follows therefore from a 
theorem of Leray [5, p. 237] that the canonical spectral sequence {Ey} is 
trivial; here {#,} denotes the spectral sequence whose final term Fo is asso- 
ciated to H* (Yr, Fo) and whose H,-term is given by Ba" = H"(Y,0©(F,)). 
Hence, an immediate consequence of Proposition 7 is the following: 

Proposition 8. i) Suppose now that o) is the only non-zero induced 
representation of o among those for OSsn. Then we have 

HUY, Ep .7) =Hr(Y,„F,), for 0S qSN, 
where po VA p® for om (A, p). 
ii) In case all o® (0OSs<n) are zero representations, we have 
H1(Yo, Fo) =0, for OSq EN +n. 

We shall now proceed to the proof of Theorem 2 by using Proposition 8. 
First we show ii): We set  —=A"!®;p, then u is the highest character of p’, 
and uE Gar. The theorem of Borel-Weil-Bott (cf. Theorem Ba) implies that 
p =p (i.e. p= 0); hence from i), Proposition 8, we infer that 

HY, Epos) = H4(¥r,F,z), 0S g=N. 
On the other hand, Kr*® F,=F,:s (cf. Corollary of Lemma 4) ; where we 
see that (F-+8,%) == (4+ 8x, a) > 0 for all a¢€ 3 since A is a dominant 
weight in [f° f°]. While, by assumption, (#+8,&) <0 for all complemen- 
tary root a. Therefore, by Proposition 5 we see that Kr*®F, is a positive 
line bundle; hence, by Kodaira’s vanishing theorem [15], we have H9(Y¥7, Fo) 


= 0 for all g>0. This proves ii). 
Next, to prove i), for p—A®p’ we put 


vo—i—8ye (vE Bu). 


Then (A +y ai) = (7,4) <0 for all Ed, while by assumption (Ä-+v,&) 
—\— pote å) > 0 for all complementary roots &. Hence, Proposition 5 


* The definition of the s-dimensional image sheaf will be recalled in the beginning 
of $8. 
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implies that F)» is a negative line bundle, and so we infer from Kodaira’s 
theorem that i i 
H (Yr, Fy») —( for all gq<n-+N. 
On the other hand, Bott’s theorem (cf. Theorem B,) now implies that 
(p's Cm) — (v9, Hr (M, F,*)); 
80 that it follows from Proposition 8 that 
HF, Epes) = Hi" (Yr, Fy»), 0 = q =N. 

Hence, combining with the above equality, we obtain the desired result. 
The proof of Theorem 2 is now complete. 


20. In case o satisfies neither the condition in i) nor the one in ii), 
Theorem 2 tells us nothing about the cohomology groups H4(Y,Ep.,). 
However we can establish the following result by using Bott’s vanishing 
theorem [5, p. 281; Cor.], in place of Kodaira’s one: 


THEOREM 3. If there exists at least one complementary positive root & 
such that (5,a) > 0, then tt holds that 
H°’(Y,E,.,) ==0 
Proof. Proposition 8 implies, as in ii) of Theorem 2, that 
A°(Y, Epos) et H? (Yr, Fo). 
The condition of our theorem and the proof of Proposition 4 imply that the 
canonical Chern form of F, has one eigen value, corresponding to a, which 


is negative throughout Yr. Hence, from Botts theorem quoted above, it 
follows our theorem. 


Remark 1. Our vanishing theorems (i), ii) in Theorem 2) are stated 
for the m-dimensional vector bundle Z,., (m= 1); however, in the case of 
the line bundle Eos, the conditions on A will be revised from those in the 
above theorems. In fact, as for the cohomology groups He (Y, E.s), we can 
immediately apply Kodaira’s vanishing theorem by using Proposition 6 and 
Cor. of Proposition 1. Thus we get a sharpened form of Hirzebruch’s results 
[10,83]: 

i) If (A,%) >0 for all a¢ ð, then Ha(Y, Ey.) =0 (q <N), and 

ii) If (A+ 8r, u) <0 for all ut ð, then H(Y,E.,)—=0 (g>0). 
We recall that Hirzebruch has been concerned in [10] with the case door ór 
(reZ). 


Remark 2. In the above arguments, we have assumed that p is irreducible. 
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While, in the reducible case, we let p =— p, @ pa: ' ' - @ px denote the decom- 
position of p into the irreducible components. Then we infer easily from the 
‘definition of Epos that Eros Epos OB Ep: D> Epos (PB denotes 
the Whitney. sum). Hence we have 


a 
HY, Epos) =È (Y, Ep, 04), Sq. 


Remark 3. We add here that the cohomology groups H1(Y, ©) have 
been already discussed by Calabi-Vesentini [6] by using the theory of har- 
‘monic forms; however, these cannot be computed by our method. 


§8. The proof of Proposition 7. 


21. Throughout this section, it will be meant by N an (arbitrary) open 

‘set of Y. We set co =p, ome (A, p). 
_ The sheaf w(F,,,) is by definition the one associated to the presheaf . 
{ow (Fy.)¥;N CY}, which is given by 


w® (Fy u)y = H’ (w> (N), Pag | o*(¥)). 


While, the sheaf Ep ., is the one associated to the pre-sheaf {(Epos)s; N C Y}, 
where 
t (Ep os)y = E° (N, Epos | N). 


In order to prove that w(® (Fa) = Epos as (analytic) sheaves, it suffices to 
show the existence of a pre-sheaf homomorphism {hy;N C Y} of 


{9 (Fyu)w3N C F} 


into {(Ep o 7)x; N C Y} which induces an isomorphism on each fibre of the limit 
sheaves: i.e., hy is a homomorphism of w®)(F,,,)y into (Ep.3)y such that 
i) hy’s commute with the restriction maps, and ii) for any point z€ F and 
any N containing z there exists an open set N CN (zeEN’) on which hy: 
is bijective. 

Recall now that the C-module H’(N,E,.,| N) may be identified with 
that of all holomorphic mappings s of g7(N) into H*(M,F,™) such that 


s(y:2) —=p(J(y,2)) se) 


for y€T andwég%(N), since the standard fibre of the vector bundle Epes 
is given by H*(Af, F). 

Before constructing {hy ;N}, we have first to define, for every s € g” (NV), 
the bundle mapping ĉ of F,™ into Faa | w-*(2V); the latter being identified, 
as in Lemma 4, with T= (N) X F,™). In fact we will set: 
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Ef) = er(a,f) E Frye | w*(N), r À 
for f€ Fa. Then the mapping ê induces on the base spaces the injective . 
mapping: : 
M> z> 9r(2,2) € w*(N). 
I we set f = [k, é]a: kE K”, ki C (cf. 53), our mapping £ satisfies then the 
following relations: : 


(72) (F) =#( [I (y, 2) 78, A(T (y, 2) NER): 


for yET, as is seen from Lemma 4. Denote by £* the homomorphism of _ 

H*(o7(N),Fy.| o7(N)) into H: (M, F,#) which is induced naturally 

by &: > - 
&*: Hi(w>(N), Fpa | 8 (N))>H°(M,F,*). 


Now we can put for every q€ H*(w (N), F,„| w>(N)) as 
hy (q) =8;8(2) =8*(n), for all zE g> (N). 


Then, by the above relations, the mapping s of g*(N) into He(M,F,M) 
satisfies the relations: 


8 (ys it) = (oe) *(n) = (A8 wh) (J (y, 2) )s (2) 


for zept(N), yET and ne H°(w(N), Faa | w>(N)). Therefore, for 
proving that se H° (N, Epos | N), we have only to verify that the mapping s 
is holomorphic. 

Let 7, now denote the projection of Xr =X X M onto M, then we infer 
that pr*Fya (= jr*Fo*) = ri*F,™ (cf. the proof of Lemma 4); we can thus 
consider the diagram i 


* 


H (w (N), Fy, | w= (N)) Lan FM) 


z+ 
pr* Žž 


H’ (grw (N), mi*F,™ | pr"w(N)), 


where y7* denotes the natural homomorphism induced by the bundle mapping 
pr: er Fa nF M>F,,„ and %* is the one induced by the bundle 
mapping &: F477 —=o1(N)X FM such that z(f)—(2,f) for 
fEF,™. It clearly holds that 2*=Z*ogr*. Therefore, in order to show 
that 2 s(x) == 2£*(y) is a holomorphic mapping, it suffices to show that 
z—>2@*({) is a holomorphic one of ¢*(N) into H*(M,F,™) for any fixed 
EE He (prt: w*(N)), 11*-F,™ | ort-w4(N)). Now take a Stein open set 


102 MIKIO ISE. 


N, for a given z such that ze g"(N,), N, CN. Then, since pr!‘ w'(N,) 
=r: p (No) =p" (N0) XM, the mapping #*— 5*(N.) will map 


He (g (No) X M, 1:* FM | (p* (Mo) X M)) 
into H*(M,F,™). On the other hand, the Künneth relation implies that 
. HN) X MR | (ep *(W0) XK M)) = HEN), D) 8 HM, FM), 


since g*(N,) is also a Stein manifold; via this isomorphism ž*(N,) is repre- 
sented such that z*(No) (a@é) == a((c) 88, where éc H*(M,F,!) and 
se H" (p>(N.), ©) is regarded as a holomorphic function on (Np). 
Hence t>a*(N,)(@@Eé) is a holomorphic mapping of (Ny) into 
H*(M,F,™). That se H°(N,E,.,|N) is thus proved. 

Next, we have to verify the relations: 


ty o hy = hy Oty 


for two arbitrary open sets N and N’ (N D WN’), where ry denotes the 
restriction mapping; in other words, it should be checked that the following 
diagram is commutative: 


N 
we (Fyn) ——> (Epos) 


N N 


TN” Ty 


wO (Fu) ——> (Ep ov) y" 
ye 
In fact, if we set s=Ay(n), tw%(s)=s’ and ryN(n)=n for any 
nE w (Fy 2)x, then by definition s(x) =£*(n) for any c€ ¢4(N). It will 
be seen moreover that s’ is the restriction, ag a mapping, of s to g> (N), and 
that £*(y!) =£*(n) for zegt(N”); hence it holds that s(x) —=£*(n’) for 
zeg (N’). This implies that = hy (x). 


22. Finally, the pre-sheaf homomorphism {hy;N C Y} defined above 
must be proved to induce in reality an isomorphism in the limit sheaves; 
namely we must show that, for a given point of Y and its open neighborhood, 
there is an open neighborhood N contained in it such that Ay yields a bi- 
jection of w®(F,,)» onto (Ep.3)x. Now, we take, as such a neighborhood 
N, a contractible Stein open set; for which we shall prove that hy is bi- 
jective. In fact, in this case, since the two bundles w(N)—>N and 
g(N)—WN are trivial, we can identify such that 


wO (Fyu)y =H (N X M, Fy a | (N X ¥)), 
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where Fy, | (N X M) =r* FM since Enos | N is trivial (7, is the projec- 
tion of N X M onto M). Hence it holds that 

ow) (Ey .)y—= He (N X M,71*-F,*). 
On the other hand, Epos | N being trivial, we may identity 
. (Epos) = Uy Q H*(M, FM), 


where Ay denoted the C-module of all holomorphic functions on N. This 
identification will be realized as follows: First we know by Proposition 1 that 


Epos | N =I\(e7(N) X H°(M,F,#)), 


where we may consider as g!(N)= TXN since g!(N)>N is trivial; 
we write thus g*(N) > s= (y,y)=y'y (yET, yeN). Then, for 
z= (y,y) Ep (N) and GE H*(M,F,™), we have the bundle isomorphism: 


p(z, $) > (yp (I (y: y)) 8) 
of Epos| N onto NX H*(M,F,.™); in fact, under this correspondence, 
(yz; (J (7,2) )€) is mapped to 

(yp Cy’ 9))* pI (7 2)E) = (ye (9) 8) 

Recalling now that (Ep.s)y consists of all holomorphic mapping s of p*(N) 
into H*(M,F,™) such that s(yx) =p(J(y,z))s(z) for zept(N),yET, 
the restriction s| N of s to N may be regarded as a holomorphic mapping 
of N into H*(M,F,™): 

` s | NE Uy @H*(u,F,™). 


In fact, for any y€ N, p(J(y,y))=:s(y:y) —=s(y)(—=£) and conversely to 
y(y,€) € Epos | N corresponds (y, £) ; hence y—> ¢ gives a holomorphic section 
of Epos | N. 

Now let r1: N X M—M and rı: N X M—N be the natural projections, 
then they induce respectively the natural homomorphisms 7,* and 7,* such 
that 

*: He(M, FM!) > H! (N X M, r, *F,™) 
ra: Wy > Arxa Ur 


(Axxa is the module of all holomorphic functions on N X M). From them, 
we get the homomorphism 


Ort: Uy O H (M, FM) >H: (N X M'n *F,™): 
while we see that this is a special case of the so-called Künneth relation, so 
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that r,*®r,* is bijective (cf. [5], p. 237). Therefore, what is to prove is 

that - 

hy © (rs*®r,*) — the identity mapping of 
Wy @ H! (M,F) onto itself. 


To show this, let a® LE Wy Q H*(M,F,) («€ My and Le H° (M, F,™), and 
“put 
(7, @7*) (a8 £) =y E He(N x M,r.*F,#) 
{hy © (t @ 11*) } (a8 E) = hy (7) =>. 


We will thereby show that s=«®£. Recall now that the bundle diagram 
in our case is as follows: 


pr ` 
NXM<—IXNXM 
wW T 
9 


M <—— TXN 


where T acts on T X N such that yo (y’,y) = (yy, Y), and does on T X N XM 
such that 


ye (y, y, 2) FF (w YJ (y, y)z), 


for yy €T, y€ N and z€ M. Thus we see 
s (y) = 3* (1) ort) (ABE) 
= ¥* (a@7,*(6)) = a (y) Yet) (2). 
On the other hand, for any f € F,M we see that 


(1109) (f) =r (ly fla) ~f; 


Hence, r,°% is the identity. This implies that (r,°y)*Z—¢. Therefore 
s(y) =a(y)£= (a8 £) (y). The proof of Projosition 7 is now complete. 


89. The case of Siegel’s symplective space. 


23. In this section, as an illustration of our main results, we will deal 
with the case where X is the irreducible symmetric bounded domain of type 
III, (the so-called Siegel’s symplectic space of degree n). Namely X is the 
space of all complex symmetric matrices x of degree n such that zö— 1, (1, 
denotes the unit matrix of degree n) is negative definite (cf. [7]). In this 
case we can put: 
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G° = §,(n,C), G* == LS, (n) LF, G == LS,(n, R) E=, 
K=L(8,(n) N 8,(n, R)) L> 
where LE GL(2n,C) denotes the matrix 


b(t car) 


Then K is the maximal compact subgroup of @ which consists of matrices 


k 0 
(E paji veU, 
whence K° consists of matrices of the same form such that ke GL(n,C). Ke 


is canonically isomorphic to GL (n, C) under the correspondence & “ay? k. 
Now we can take the maximal torus T of K such that 


: A 
r= 2.) tom L, ptm eR) 


ied Sor 
r= e(o L) fias 4 2. ) ly€ C}. 


We set here 4(h) = Ay (SiS n), mhin (1LSiSn—1), ån An 
Then {G1 &a' * *, &%} constitutes a simple root system of g=3p(n,C), 
and d == {G1, G2," °°» Qna} a simple root system of [f°, f°] —8l(n,C€). More- 
over we know that the fundamental dominant weights system corresponding 
to {ĉo &2, * *,Gm} is given by 


=i +4 (LSiSn), 


then 


and that n 
= 2 (At 4A), Sa (A H + And); 
Sr — (n+ 1)ån. 


For the linear order given by the above simple roots system, we infer readily 
that 


15 For the root system and the root vectors of 3p(n,C), we refer to [13]. 
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rai? ie, eae? Oinoa 


wih? I Nem {(* ed 


On the other hand we see that @ consists of matrices ( j ;) such that 
a= À, b = 6, tao m tca, 
taa— ti 1}. 
G acts on X transitively by the following rule: for g -(; 2) E€ Gand re X. 
g- a= (ac +b) (2+ 4)". 


Then, the basic point £ € X is the zero matrix of degree n (K is the isotropy 
subgroup of G at zo). We see without difficulties that G C N+K°N~, and that 


1, -2 


ji (z) -6 Se zeX; 


moreover we have (cf. Lemma 1 in $1) 
se ; t(ca + d) 0 ) ( i, R 
4 ju(2) =j lga) ( 0 csta] \(ca+d)+-¢ 1,/° 
Thus we can put 
J (g, 2) =+ (cz + d)”, 
after identifying K° with GL(n,C) through the canonical isomorphism con- 
sidered above. It follows then that the Jacobian of g at x is given by 
(8x07) (g, £) = det (cr + d). 
We consider now the irreducible (holomorphic) representation p of 


GL(n,C) over Cr with the highest weight o; then we may write as 


ə o o mi o 
=A -jH a; Am PAn p= D pihi, 
1 
where p and p, (1Si=n—1) are integers such that p= 0 (1Sisn—1) 
and p may be arbitrary. 
Under these circumstances, Corollary of Theorem 2, Theorem 3 and 
Remark 1 in §7 now imply: 


n-1 
THEOREM 4 i) If p— žm > mn—?, or tf o==A (i.e. m==1) and 
p> 0, then 
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H(Y, Epc) =0 for ol q <N, 
; N ocs (2%) | ` 
i dime H (Y, Epos) = (4r) 2 IT yy ¢8(P) deg (3), 


where vg(Y) denotes the total volume of Y with respect to the Siegels volume 
element (cf. [11]), and deg(&) denotes the degree of the irreducible repre- 
sentation of S,(n,C) whose highest weight is & 


n-1 
ti) If p +È p <—2n, or tf om) and p<—n—l, then 
H1(Y, Ep3) =0 for all g>0, 


Lid ° 
dime H° (F, Epos) — (dr) N2» TI -El vg(¥) deg (# + 8x), 
i (2%) | 
where & denotes the highest weight of the contragredient representation of p. 


-1 
iii) If p +5 m>0 (in particular, if pZ0 and p is non-trivial), then 
= 
x H°(Y, Epos) ==0, 


$10. Final remarks. 


24. Throughout the present paper, our methods have been mainly an 
analogue of those in Bott [5]; while Bott has considered not only G*/K and 
G*/T, but also any compact kählerian homogeneous space G*/H = X". Thus 
it will immediately call our attentions to the quotient manifold Yr=T\G@/H 
of Xa = G/H by I, in case H is contained in K. Indeed, we may construct 
at once the commutative diagram analogous to that in § 3. 


or jr 
Yr 1 Xr It 


"TE 


Ya nase” © Feen Xx 
pH Ja 
where the mapping jr: ju(gH) =gU’ (Xy*=—G°/U’) is injective, since 
UNnG=H is also valid. Further, Ya being the total space of the holo- 
morphic fibre bundle Ya(Y,K/H,K°) with the kählerian homogeneous space 
K/H as the fibre, we infer from a theorem of Borel [9, p. 140] that Yy is an 
algebraic manifold. Let H’p—G° xy C™ be now the homogeneous vector 
bundle over Xp” associated to p € Hom (H°, @L(m,C)) = Hom(U’, GL(m,C)), 
then there will be defined the holomorphic vector bundle T’yja*Z,’ over Yu. 
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For such a bundle we can prove the vanishing theorems and the proportionality 
theorem in a quite similar way to the case H == K ; though they would have 
at present no connections with automorphic forms in the usual sense. 


Added in proof. The statement of the condition (b) for the discrete 
subgroup T in §2 must be revised, because G acts on X not effectively in 
general: Denoting by Z the (finite) center of G (Z consists of all g € G which 
acts trivially on X), we have to replace T in (b) by T/TNZ. 


COLLEGE OF GENERAL EDUCATION, UNIVERSITY OF TOKYO. 
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HARMONIC MAPPINGS OF RIEMANNIAN MANIFOLDS.* 


By James Ers, Jz. and J. H. SAMPSON. 


Introduction. With any smooth mapping of one Riemannian manifold 
into another it is possible to associate a variety of invariantly defined func- 
tionals. Each such functional of course determines a class of extremal 
mappings, in the sense of the calculus of variations, and those extremals, in 
‘the very special cases thus far considered, play. an important rôle i in a number 
of familiar differential-geometric theories. 

The present paper is devoted to a rather general hd: of a functional E 
of geometrical and physical interest, analogous to energy. Our central problem 
is that of deforming a given mapping into an extremal of Æ. Following an 
infinite-dimensional analogue of the Morse critical point theory, we construct 
gradient lines of F (in a suitable function space); and F is a decreasing 
function along those lines. With suitable metric and curvature assumptions 
on the target manifold (assumptions which cannot be entirely circumvented, 
in view of the examples of §§ 4E and 10D), we prove that the gradient lines 
do in fact lead to extremals (see Theorem 11A). 

IE f:M>M’ is a smooth mapping of manifolds whose metrics are 
gydxdas resp. gap’dy*dy®, then the energy E(f) is defined by the integral 


EG) = 4 f gee oe ot #1, 


where the f* are local coordinates of the point f(x), *1 being the volume 
element of M (assumed compact). Thus E(f) can be considered as a 
generalization of the classical integral of Dirichlet. The Euler-Lagrange 
equations for E are a system of non-linear partial differential equations of 
elliptic type: 
afet Tare n i g" = 0; 

A is the Laplace-Beltrami operator on M and the Ta,“ are the Christoffel 
symbols on M’. Although this system is suggestive of the simple equation 
Au + $(u) grad’u=0 for one unknown, there is in general very little con- 
nection between the two because of the phenomenon of curvature. 


Received April 22, 1963. 
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It has been necessary to go into the question of existence of solutions 
in rather great detail, owing to the want of general results for non-linear 
systems. Direct methods of the calculus of variations seem to lead to severe 
difficulties, and that is one reason why we have preferred to approach the 
problem through the gradient-line technique, which amounts to replacing 
the equations above by a system of parabolic equations whose relation to the 

+ elliptic system is analogous to that of Fourier’s equation to Laplace’s equation. 
This approach is of independent interest, in any case. Our methods are 
strongly potential-theoretic in nature. The local equations are first replaced 
by global equations of essentially the same form, embedding M’ in a Euclidean 
space. A stability theorem is established showing that a solution of the 
resulting parabolic system does in fact produce a 1-parameter family of 
mappings of M into M’. Fundamental solutions of Laplace’s equation and 
the heat equation on (compact) manifolds are used to establish a prion 
derivatives estimates and to construct solutions of the parabolic system, the 
latter being translated into a system of non-linear integro-differential equa- 
tions of the Volterra type, following the method used by Milgram and 
Rosenbloom in a linear problem. Curvature enters in a manner not unlike 
that exploited by Bochner in [4]. 

Special cases of our extremal mappings go back to the very beginning 
ef differential geometry. E.g. they include geodesics, harmonic functions, 
and minimal submanifolds. For minimal surfaces they were first studied 
locally by Bochner [2], in an explicitly Riemannian context. That work was 
carried to completion by Morrey [19]. In a report prepared by J. H. Sampson 
in February of 1954 at the Massachusetts Institute of Technology, the subject 
was taken up from a somewhat different point of view, and other geometrical 
applications were discussed. Since firm existence proofs were not then avail- 
able, general publication of the results did not seem warranted. Shortly 
thereafter, J. Nash and, independently, F. B. Fuller [10] advanced the same 
definition as that on which this article is based, and Fuller described several 
examples. The problem has also been considered by E. Rauch. 


The contents of the present paper are presented in the following order: 


Chapter I. The concepts of energy and tension. 
1. The energy integral 

The tension field 

Invariant formulation 

Examples 

The composition of maps 


pm» 
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Chapter II. Deformations of maps. 
6. Deformations by the heat equation 
7. Global equations 
8. Derivative bounds for the elliptic case 
9. Bounds for the parabolic case 
10. Successive approximations 
11. Harmonic mappings 


Added in proof: The theory of the energy functional (and its harmonic 
extremals) is the first-order case of a general theory of p-th order energy 
(and its polyharmonic extremals). See J. Hells, Jr. and J. H. Sampson, 
L'énergie et les déformations en géometrie différentielle, Colloque du CNRS 
(Proceding of a conference held in Grenoble in July, 1963) for a general 
formulation in fibre bundles. 


Chapter I. The concepts of energy and tension. 


1. The energy integral. 


(A) Let M and M’ denote complete Riemannian manifolds of dimen- 
sions n and m, respectively, and suppose further that M is closed (i. e., compact 
and without boundary) and oriented. In the interests of simplicity we assume 
that both manifolds and their Riemannian metrics are smooth (i.e., of class 
0”); however, it is not difficult to make minor modification to include 
differentiability class ©". We will let (z',- - -,a2*) denote local coordinates 
on M in a neighborhood of a point P (said to be centered at P if (0, : -,0) 
are its local coordinates), and (y*,: - -,y™) local coordinates on W’. Thus 
we can write the Reimannian metrics g and g’ in these local coordinates as 


dg? = gydarda?, ds’? = Gapdyrdyp, 


where we observe the summation convention ; generally, when using local tensor 
calculus we follow the notations of Eisenhart [8]. We will denote covariant 
derivatives without the usual commas; e. g., 


fit === ofr/dx* fyt == gfe /dxtdx4 — TF fi. etc., 


where T,* denote the Christoffel symbols. 

With any smooth map f: H—> W we assign a real number called its 
energy, as follows: For each point P € M we let <,>p denote the inner product 
on the space of 2-covariant tensors of the tangent space M(P) to Mat P; 
thus if (e*)isis,n is a base for the cotangent space W(P) of M(P) and 
a = oe! Q ef and a’ are 2-covariant tensors of M(P), then 
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<% dp 27 arg, 
where g**g,,—=8,'. Since the metric tensor g’ of M’ is 2-covariant, it induces 
through f a 2-covariant tensor field f*g’ on M, whence we can define the func- 
tion P— <g(P), (f*9)(P)>p on M. We will call e(f)P = 4<g(P), (f*9)(P)>p 
the energy density of f at P. Its dual differential n-form e(f) *1 can then 
‚be integrated over M, and with an eye toward the physical concept of kinetic 
energy (mv?/2) we define the energy of the map f by 


(1) | EQ) = J, eet. 


In a local coordinate representation we have 


B(G) = fof tPa’caldet(gu) Bde N "A de 


where fi =— Of"/dzt. Observe that if the local coordinates centered at P and 
f(P) are both chosen to be locally Euclidean at their centers, then 


PAD, 


so that e(f) is non-negative, and E(f) vanishes when and only when f is a 
constant map. : 


(B) Although the present work is devoted primarily to the functional 
‚E and its extremals, there will be the indications (e.g. the example § 4E) 
that we will want ultimately to consider other types of energy of maps. We 
give here a general method of constructing these. 

Starting with the manifold M and any smooth symmetric 2-covariant 
tensor field « on M, we fix a point Pe M and form the proper values of « 
relative to the metric tensor g of M; i.e., the n real roots of the equation 
det (gy(P)A—ay(P)) ==0. Apart from their order, these proper values are 
intrinsically associated with a and P; thus we are led to forming their sym- 
metric functions. 


Definition. Let o be any symmetric real function of n variables. For any 
symmetric 2-covariant tensor field «on M we let c(a): M—R be the function 
such that o(a)P—the o-function of the proper values of «(P) relative to 
a(P). The o-integral of « is the number 


I,(@) =Í o{«)*1. 
M 
in particular, let op denote the p-th elementary symmetric function. 
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Then setting po=1, 4p ==07/ (7) ve have Newton’s inequalities pripon (io), 
with equality if and only if all proper values A, are equal; furthermore, if all 
A420, then 

(2) a = [wa]? D [os] 2 > > [on], and 


pa/ bo = pa/p1 ZZ n/H These provide some sort of comparability of 
the various o-integrals of « We have 


o, (a)P =g” (P)ay(P), on(a)P— det[ay(P)]/det[gy(P)], - 


and in general 
Ru 


op(a)P= (def) 2 | ml, 
HS <tp | Ur" "Am 


Jia’ © "Im 

Remark. These integrals provide many variational problems of differ- 
ential geometric interest. For example, if we take for g the Ricci tensor of M, 
then its proper values are the principal curvatures at a point, and o,(@) is 
the scalar curvature function. If we take for « a second fundamental form 
(for a given direction) of an immersion of M, then o,(«) is the Gauss- 
Kronecker curvature function (for that direction). 

For the present purposes we take a—/*g for some map f. Then 
(7 )u—= H TPg ap and o,(f*9’) = <9, f*9’>; we are led to the 

Definition. For any map f: M— W’ and any symmetric function o of 
n variables, the o-energy of f is the number 


Half) See. 


We observe that the energy of f is the (01/2)-energy of f. 
Let J;(P) denote the Jacobian of f at P; i.e., the image under f of the 
unit n-vector of M(P) defining the given orientation of M; thus 


on(f*g')P = Jy(P),Js(P)>/det(gy(P)), 


where the inner product is that of the space of n-vectors of M’(f(P)). The 
volume of f is the number 


(3) DS rt. 


Note that V (f) —0 if n>m. 


8 


114 JAMES HELLS, JR. AND J. H. SAMPSON. — 


Remark. If we consider g + Af*g == ds)? as a perturbation of the metric 
of M for = 0, then the corresponding volume element is 


#1, = [det (gy + Aff; J ap) dat A+ + + A dar. 
A simple calculation shows that 


` E(f) EN (M) reo 
where V,(M) = f ed 


(C) We give here an interpretation of E(f) as a measurement of dis- 
persion; the calculations of this PRROFSPN will not be used in any essential 
way later. 

Let r’(P’,Q’) denote the geodesic distance between the points P, Q’ € MW, 
and suppose P,QEM are points such that f(P) =P’, f(Q)=—=@. For a 
fixed P we consider the function Q—r”?(P’,Q’); it is elementary that, for 
Q sufficiently near P, that function is smooth. 

Let Af == gtify denote the Laplace-Beltrami operator on the function f. 
We calculate the Laplacean of r’* qua function of Q. In coordinates centered 
at P and P’ we have 

2/2 
Bar (P, g) = gt AE — gir 





A simple calculation gives 


sgu Pr Hyg? or 
Aart =g gyagya a8 Oat T aye OY" 





Now 
dr’? 
-= a Werl) +0) 
as Q — P, whence 
agr? (P, Q") = elf) P +0 (7). 


For any smooth function u defined in a Ben of P let ü.(P) denote 
the average value (e>0) 


i(P) = f u17 (B), 


where = {Q E€ M: f(P,Q) Se}. 

We require Maxwell’s relation [16, p. 31. The formula is easily proved 
by expanding u in a Taylor’s series at the center of a normal coordinate 
system. |: 
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ae(P) —u(P) +y ra P) HOLE). 
Applying this to u(Q) =r”*(P’,Q’) and noting that u(P) 0 and 
Au(P) = lim Agr’? (P’, Q) == e(f)P, 
Pr . 
we obtain 


Z 7 Re 8 
J, Pga B) = APO). 


If ¢.(P, Q) is a smooth function which is zero for r (P, Q) Ze and equals 
1/V (Be) for r(P,Q) Se, then we obtain from our last equation 


f, NP, Ql =m BU) +08. 


Naturally certain uniformity conditions must be fulfilled by the error terms 
for the validity of this formula, but since we make no essential use of the 
result, we shall not insist on that point. The left member of the preceding 
equation represents the mean square infinitesimal dispersion of the image 
points on M produced by f, and that quantity is estimated by the energy of f. 


2. The tension field. 


(A) In this section we examine the extremals of F, interpreted as the 
zeros of the Euler-Lagrange operator associated with #. For this purpose 
we let +: J (MW) > W denote the tangent vector bundle. We let 9 (Ai, BI’) 
denote the totality of smooth maps from M to Al’; then for every f € Y (If, M’) 
the set of smooth maps u: M—>J(M’) such that rou—f forms a vector 
space #(f) with algebraic operations defined pointwise; such a u is called a 
vector field along f. We define an inner product in #(f) by 


KU, vr = fs (P),v(P)yrm #1. 


For any vector field v along f the directional derivative of E in the 
direction v, 


VER) FE (fi) Ino, where fe(P) = expr (¢0(P)), 


is the endpoint of the geodesic segment in M’ starting at f(P) and deter- 
mined in length and direction by the vector w(P)EM’(f(P)). We show 
in (B) below that the Euler-Lagrange operator applied to a map f defines a 
vector field +(f) along f which is the contravariant representative of the 
diferential of E at f; ie, 
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VEN =—<r(f),0>y for all ve X(f). 
Thus the maps f for which +(f) =0 are (so to speak) the critical points of E. 
(B) Lemma Let fi: M>M’ be a smooth family of maps for t in 
some time interval u <t<t. Then 
d a a af? 
(4) ae (ft) = — J, Af + ai faf loa #1, 
where A denotes the Laplace-Beltrami operator. 


Proof. From the definition (1) we obtain for any tE (to, ti) 








ae (fe) = iS, 9 Rfi Efe Gap + fife “gee. M oF” Di, 


The quantities 


él == gE “of Ib 


dat 


are the components of a contravariant vector field £ on M, whence by Green’s 
‘divergence theorem 
f & j +1 = 0. 
M 


B 
Í. gia M ag thie PIE gfe + fea ir pee ts ial 


I.e. 








A routine calculation now gives (4). 
For any smooth map f€ (M, M’) we set 


(5) (IP) = AJY (P) +g” (P) ap (f (P) fe (PIF (P). 


It is clear that +(f)7 is unaffected by any transformation of the local coordi- 
nates on M near P, and for any such transformation of coordinates near f (P) 
we see that r(f)Y(P) transforms as a contravariant vector in M’(f(P)); 
see $3 for an invariant formulation. Thus with every fE ¥(M, M’) we 
have a variation r(f) € Y (f). 


Definition. We call r(f) the tension field of the map f, and we say that 
f is a harmonic map tf +(f) == 0. Thus (4) becomes 


m Sen Boa. 


Suppose now that f is an extremal (with respect to small deformations) 
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of E. If we apply (4) to suitably chosen local deformations (e. g., confined 
to small geodesic balls on M), we obtain from a standard argument that the 
Euler-Lagrange equation for the energy functional E ts r(f)==0. In local 
coordinates that equation ts elliptic. 


Remark. It is a simple matter to modify these constructions to include 
the case that M has a boundary; we should require in Lemma 2B that f; is a 
constant function of t on the boundary. 


Proposition. Every map f: M —> W of class C? which satisfies r(f) —0 
is smooth. If M and M’ are both analytic Riemannian manifolds, then every 
such map is analytic. 


The proof of the first assertion is easily obtained by inductive application 
of [14, Theorem 3, p. 210]; analyticity follows directly from [22, p. 4]. 

(C) Our next step is to interpret the tension field z(f) in terms of 
special coordinate systems on M and W’. 

For any PEM we let expp: M(P) > M be that map which assigns to 
each vector u € M(P) the end point of the geodesic segment emanating from 
P and determined in length and direction by u; it is elementary that expe 
is a smooth surjective map, carrying a neighborhood of 0€ M(P) diffeo- 
morphically onto a neighborhood V of P in M. If we now choose an ortho- 
normal frame in M(P), then we can use the inverse of expp to refer each 
point QE V to the components relative to that frame. These are called 
normal coordinates in V centered at P, and they form a coordinate system 
admissible for the differentiable structure of M. 

In terms of P-centered normal coordinates we have 


1) the metric tensor gi(P) = êy, since the frame is orthonormal; 

2) the Christoffel symbols T,%(P) 0 for all i, j, k; that is because the 
equations of the geodesics through P are linear, whence T4} (Putu! —0 
for all vectors ve M(P); see Eisenhart [8, p. 54]. In particular, fy”(P) 
= Of (P) /dc'923, from which we obtain the 


Lemma. For any fE 9 (M,M’) and point PE M let us fiz normal coordi- 
nate systems V and V’ centered at P and P’==f(P), respectively; in terms 
of these we have 





EN, (1<Sy<m) 


ii ð (xt)? 


Thus f ts harmonic if and only if at each pair of points P, f(P) there are 
such coordinates tn which f satisfies the Euclidean-Laplace equation at P. 
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Example. Suppose Jf’ is flat; i.e., its Riemannian curvature is zero at 
every point. It is well known that then M’ admits a smooth coordinate 
covering such that in each coordinate chart we have I’ag’=0. Then 
+(f)7 = Af”, and in such local coordinates the equation +(f) 0 ts linear. 
In particular, if M’ is the Euclidean space R™, then a map f: M>Rr is 
harmonic if and only if it is constant, by the maximum principle. 


Example. If M and MW’ are Lie groups with bi-invariant Riemann metrics, 
and if f: M—>M’ is a homomorphism, then f is harmonic. It suffices to 
verify this at the identity of M; taking canonical coordinates (which are 
normal; see Chevalley [5, p. 118]) at the neutral elements of M and M’, we 
see that the representation of f is linear, whence +(f) == 0 by Lemma 20. 


Example. If M and W are Kahler manifolds and f: MMW is a 
holomorphic map, then f is harmonic relative to the associated real Riemann 
structures on M and M’. Namely, we take local holomorphic coordinates 
zi =x + V— iri and w= y" + V—1y** (where dim M =2h, dim M’ 
= 2k) centered at some points P€ M, f (P) € M’. Because the w% are holo- 
morphic functions of the zf and because M is Kähler, they satisfy Laplace’s 
equation Aw" == 0. Now A is a real operator, which we have Ay® — 0 — Ay* 
for lak. Since M’ is Kahler, the w* can be chosen to be normal coordi- 
nates, whence all Iag” == 0 at f(P). Then «(fJP=0. l 

(D)Suppose f: M>M’ is a Riemannian immersion. Thus for each 
PEM the differential fẹ(P) of f at P maps M(P) isometrically into 
M’(f(P));ie, g=f*g. If éo) (1&0 &m— n) is an orthonormal frame 
in (some coordinate system) on M’ orthogonal to M, then 


(6) bajy = (fy? + ap fi fE) g yro” = boji 


are the components of the second fundamental form 8(f) on M in M’ relative 
to that frame (Eisenhart [8, §50]). The vector field ¢ along the map f 
defined by 


(7) (P) = 39" (P) boiy(P) Eo (P) 


for al PEM is Saeed of choice of frame. It is traditionally called 
the mean normal curvature field of the immersion. The following formula 
is a well known interpretation: 


E(P) =— F div (Eo) (P) )fei (P). 


Note that the coefficient of each és] is the first elementary symmetric function 
of the proper values of boj relative to g; that indicates how the following 
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results (and those of $4C) will generalize when we replace energy by o-energy. 

A Riemannian immersion is said to be a minimal immersion if &=0 on 
M. The minimal immersions are precisely those which are the extremals of 
the volume functional V (Eisenhart [8, p. 176]). Usually the notion of 
minimal immersion is taken in a somewhat broader context, as a smooth map 
which is an extremal of V. There are examples (even for M’=—-R™ and 
n—2) of analytic extremals of V which are not strictly immersions, for their 
Jacobians vanish at isolated points. 

From (7) we conclude that 


b= E 9! (fu + Pashto vote" 
=F e (f), botol: 


But (fy? + es fefF) g yf =0 (1SkSn) in general (Eisenhart [8, 
p. 160]); ie, r(f) (P) is perpendicular to M (P). 


Proposition. Let f: M—>M be a Riemannian immersion. Then 
e(f) =n/2. The tension field t(f) coincides with the mean normal curvature 
feld on f. In particular, f is harmonic tf and only if it is minimal. 


Note that any isometry f: M—>M is harmonic, and that any covering 
map is harmonic. 


Remark. For any weM’(f(P)) perpendicular to M(P) we have 
<7 (f), u> = trace (8 (f) 1). 


(E) For any map fE Y(M, M’) we define F: M>M XM’ by F(P) 
== (P,f(P)); then F is a smooth imbedding, but not isometric in the product 
metric on MX W’. The following result is immediate: 


Proposition. For any FEH(M,M’) we have e(F) =n/2-+-e(f). 
Furthermore, f is harmonic if and only if F ts harmonic. 


8. Invariant formulation. 


(A) In this section we express our problem in terms of differential 
forms with values in a vector bundle. It turns out that in some sense the 
harmonic theory of such forms gives us an infinitesimal solution to our 
problem. We begin by summarizing the general theory; for details see 
Spencer [27] or Bochner [4]. 
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1. Let W—>M be a smooth vector bundle over M with fibre dimen- 
sion m. If JPl(M)—M denotes the bundle of p-covectors of M and if 
W®IP(M)>M is the tensor product bundle, then the smooth sections 
of that latter bundle are called the smooth p-forms on M with values in W; 
their totality forms a vector space, which we denote by Ar(M,W). 


-. 2. Suppose that W has a Riemannian structure; i.e., a given reduction 
of its structural group to the orthogonal group in dimension m. If W—> W*. 
denotes the dual bundle of W, then we have a bundle isomorphism y: W > W*. 
Taken together with the canonical isomorphism *: JP!(M)—> J'™*1(M) 
induced from the given Riemannian structure on M, we have the natural map 
Y+: Ar(M,W)—>A"?(M,W*). In particular, the evaluation of W* on 
W induces a bilinear pairing 


#: Ar(M,W) X Ar(M,W) > Ar(M), 


the vector space of real valued n-forms on M. Thus Ar(M,W) has the 
inner product 


(8) bir f ety 


3. Assume next that W has a connection which is compatible with its 
Riemannian structure; i.e. the covariant differential of the tensor field 
defining the orthogonal reduction of W is zero. We say that W ts a Rieman- 
nian-connected bundle, Then we have a linear map å: Ar(M, W) —> Artı(M, W), 
which can be described as follows: If U is a locally finite covering of M by 
coordinate systems, then for each U € U the connection in W can be given by 
a certain m X m matrix 9U— (6248) of 1-forms in U. Similarly any form 
¢¢€ Ar(M,W) defines an m-tuple p7 == (gY) of p-forms in U. If d denotes 
the exterior differential operator in U, then we define d$ by giving its repre- 
sentation in each U by the formula (In this section (3A) we violate our 
convention of lettering subscripts denote covariant differentiation. We adopt 
here a special symbol for that concept.) 


(db) = dg? +67 A $7 
= (dp: + 6,58 A p8, dm + Oml A op”). 


4, We can now develop the theory of harmonic forms on M with values 
in a Riemannian-connected bundle. We have the adjoint map 8: A?(M, W) 
— Ar (M,W), characterized by the formula 


<de, p> = <p, BY). 
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In particular, for any p€ A'(M,W) and any coordinate chart U we have 
1-forms da’ (1am), which can be expressed 


dal = bay! dai in the coordinates (z},- > -+,2") in U. 
If we write similarly 


balh == Taf dat, 
then 


Fs) aU (Ob Be) dzi A da! 

(db)a ae (Zu + Ta PB; ) A > 
(9) 

(86) =— g" (Vipa + Tapp), 
letting V; denote covariant differentiation on M relative zt. The Dirichlet 
integral of € A? (M, W) is 2D D (p) ~ <add, dey + 8p, 86), and its associated 
Laplace operator ig À =— (d8-+8d). A form HE 4?(H, W) is harmonic 
if Ab=0; that condition is equivalent to the pair å$ = 0 == Bp. 

It is known that a Green’s form exists for the operator A, from which 

it can. be proved that there is a decomposition 


(10) A?(M, W) = H?(M, W) @ [dAr-!(M, W) + $4r(M, W)], 


where ZP(M,W), the space of harmonic p-forms with values in W, is 
orthogonal to the other two summands. ‘ 


5. The curvature of the connection can be expressed in U by an m X m 
matrix of 2-forms ©U — (825°) where ©U == d8 HU A 0%, If V denotes 
the covariant differential of M, then we define the covariant differential Y on 
pe Ar(M,W) by 

VG? = VE" HOT A 7. 
Letting R,* denote Æ*I, the diagonal m X m matrix each of whose diagonal 
terms is the Ricci tensor field A (we follow the sign convensions in Eisenhart 


in defining Ry = R%,_,), we have for any p€ A!(M,W) the following expres- 
sion for the components of the Laplacean of ¢ in U: 


(— Ap) U =— (VEN) + #[ (0%) 4 Sete 
where ¢ denotes the transposition of matrices. 
If ¢,y¢ A*(M, W), define the function ¢-y—=*(¢#y) on M; then in 
U we have (usual Laplacean A of functions) 
ade) (— AG?) — (VY) a($7)207(V7)#(g7)* 
—*[ (87) &— RE] (67)n0" (N, 


122 JAMES BELLS, JR. AND J. H. SAMPSON. 


where a¥ denotes the Riemannian structure of Win U. For each de AM, W) 
define the function 
(11) Q(g) = LE) — RATE) nal (BP). 
The matrix (of functions) of Q is 
Qag” = g"*g'4| (day Bye) ry — dap” Rig]. 

We consider this as an nm X nm matrix in the subscripts (ah), (8i) ; as such, 
it is symmetric: Qag™ == Opa. 

The integral over M of A(¢-¢/2) is always zero, by Green’s theorem. 
Thus tf & is harmonic we have 


(12) Son (TUE VE M1 SO. 


(B) Given any fE (M, M’), let fF (M) — M be the induced vector 
bundle; it is clearly Riemannian-connected. Let us interpret the preceding 
development for that bundle. 

First of all, the elements of A°(M,f*J(M’)) are canonically identified 
with the vector fields along f (i.e., with the elements of the space X(f), in 
the notation of §2A). Secondly, for any Pe M the differential f,(P): 
M(P)—>M’(f(P)) is a linear map, to be considered as an element of 
M’(f(P)) ®M")(P) ; otherwise said, the assignment P—>f,(P) determines 
a specific 1-form f€ A!(M,f'J (M’)). Thirdly, we have 


EA =i f fs # fe 
M 
_ Immara. For any fE (M, M’) we have dfy—0; àe., fy is orthogonal 
to 3A? (M,FTI(M’)). Thus Ay, =— d5f,. 
Proof. Take a coordinate chart U on M, and write 
(13) OyTP == Tap fi" dat, 
Then (f47)8 =f dzi, whence (1<a<m) 


- ð 7 
az dat N dal + WaptfefP det A det, 





which is zero, because both coefficients are symmetric in 4, j. 
Similarly, the variation df, € A°(M,f*J(M’)) has coordinate represen- 
tation E 
(fa) v = — gH {VNV ft + apf —r (fF). 
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Proposirion. For any fe 4 (M, M) tts differential fẹ is a closed 1-form. 
Its tension field +(f) =—— Sf, the divergence of its differential. The map 
f ts harmonic tf and only if tts diferential ts a harmonic 1-form. 


Definition. For any map fE N(M, M’) its fundamental form B(f) is the 


covariant differential Vf, of its differential. Thus 8(f) is the FI (IM’)- 
valued 2-covariant tensor field on M whose coordinate representation is 


fe fut + ap fatty? = fx. 


The tension field r(f) is just the trace of B(f); ie, If) = gf ay? 
(1Sy=m). It follows from §2D that if f is a Riemannian immersion, then 
ß(f) is the second fundamental form of M in W’. Analogously, let us say 
that a map FE 4 (iM, M’) is totally geodesic if B(f) =0 on M; we will see 
as a consequence of Corollary 5A below that totally geodesic maps map 
geodesics into geodesics. 


(C) Let us consider the function Q (fẹ); from the expression (@ag”)* 
= g% Rosh. fe we compute (11), taking into account the skew symmetry 
Bag! = — Oga to obtain the 


Lemma. For any smooth map f: M>M’ we have 


(14) Q (fe) = — Papyafrf Pp — RYT Pg ap 
Its matrix (for arbitrary forms € A (M, fT (M’))) is 


(15) Qag! = — R'apyofi fg” g — R44 g'ap. 
If f is harmonic, then 
(16) Ae(f) =| 8P |+ O (fa). 


We will refer to the matrix (15) as the Ricci transformation on the tensor 
product bundle IM’) & J™(M). Observe that if f is a real-valued 
function on M, then that Ricci transformation is just that given by the Ricci 
tensor of M. 


Remark. The above computations can of course be made without passing 
through the medium of vector-bundle-valued differential forms. One starts 
by applying the Ricci identities (Eisenhart [8, p. 30]) to the direct evaluation 
of Ae(f), and then reads off the appropriate terms. 

The next result follows the well known pattern of Bochner; in [2] 
Bochner has also applied the method in a special case for maps. 


TEOREM. If f: MM’ is a harmonic map, then 
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f Ofe)*1S0, 
M 


and equality holds when and only when f is totally geodesic. Furthermore, 
if QO(fy) 2O on M, then f is totally geodesic and has constant energy 
density e(f). 


- Proof. This follows at once from Stokes’ Theorem 


J, de eto, 


applied to (16); for if Ae(f) =0, then Ae(f) = 0 everywhere, whence e(f) 
is a constant function. 

Following the conventions of Eisenhart [8], we say that the Ricci 
curvature of M is non-negative if at every point P € M the matrix > Ry(P)) 
is positive semi-definite. 


COROLLARY. Suppose that the Ricci curvature of M is non-negative 
and that the Riemannian curvature of M’ ts non-positwe. Then a map 
f: M> M is harmonic tf and only if it ts totally geodesic. Furthermore, 


1) if there is at least one point of M at which its Ricct curvature is 
positive, then every harmonic map f: M—> M’ is constant; 


2) if the Riemannian curvature of M’ is everywhere negative, then 
every harmonic map f: M—> W is either constant or maps M onto a closed 
geodesic of M’. 


Proof. The theorem shows that 
R'agrof FP E tggi + RAT Pg a0. 


I£ hypothesis 1) is satisfied at PE M, then f,(P) —0, whence the constant 
e(f)=0; i.e, f is a constant map. If hypothesis 2) is satisfied at 
P’==f(P)¢€M’ and we take normal coordinates centered at P, then the 
f#(P)-image of the tangent space M(P) has dimension <1. If it has 
dimension 0 at any f (P), then again e(f) = 0; otherwise, the image f,(P)M(P) 
has constant dimension 1. Because f is totally geodesic, the conclusion follows. 


Example. If f: MM’ is a harmonic immersion, then e(f) —n/2, 
and | @(f)|?+Q(fs) —0. This relation also follows from Gauss’s equations 
(Hisenhart [8, p. 162]) 


Rapa Haufe (bo|ubojn— dejubo| sx) 
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by multiplying by gg}! and summing. We obtain 
Egy + Rapeli fP otg g = | BAR) P— Zu, 


where uo = g*bojy is the o-th component of the mean normal curvature of 
‘the immersion (see (7)); each po == 0 if f is harmonic. For instance, if the 
Riemannian curvature of M’ is non-positive and if the scalar curvature 
R= Rigy of M ts negative at some point, then there is no harmonic 
immersion of M in W. 

4, Examples. 


(A) The case dimM—1. Let us take for M the unit circle $+, coordi- 
natized by the central angle 6. For any f€(S1,M’) we have 


ep) =p EE ah Jag, whence E(f) =} S. bi 








'The tension field is 


le Er E 


which (when the parameter of f is proportional to arc length) is often called 





the curvature (or acceleration) of f. We have (r{f) Ty 0, and r(f) is 


proportional to the geodesic curvature vector field along f. Then f ts harmonic 
if and only tf f defines a closed geodesic on M’. It is well known that if W’ 
is compact, then in every homotopy class of maps S1—> W there ts a harmonic 
map (and furthermore, one which minimizes the length in that homotopy 
class.) On the other hand, without further restrictions on g’ there are com- 
plete Riemannian manifolds W” and non-trivial homotopy classes of maps 
-> W having no harmonic representatives; see 810 below. 


(B) The case dim M—2. We established here certain relations showing 
the close connection of our problem with the Plateau problem, in its potential 
theoretic formulation (Morrey [19] and Bochner [2]); incidentally, we see 
that in our energy theory the cases dim M <2 are favored. i 

Recall that a map h: M—> M’ is conformal if there is a smooth function 
0: M— E such that 

hag! — exp (20)g. 


Thus the differential hy preserves orthogonality and dilatates uniformly. 
Clearly such a map is a smooth immersion, and has energy density e(h) 
== n exp (20) /2. 
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Proposrrion. If dimM—=n=2 and h: M>M is a conformal diffeo- 
morphism, then for all fe #(U, 3 we have E(foh) = E(f). Moreover, 
h is harmonic. 


Proof. First of all, (f o h)€ = fp hp, whence 2e(f oh) = g heh f,*f Eg ap. 
The conformaltity condition for A implies gthph/ = exp(20) gr, and sub- 
etituting gives 


2e(foh) = FEIERN —=2 exp(26)e(f). 
Secondly, we have 
h* (#1) = [det ( gpqhPhy®) /det (gy) J +1 
— exp (nd) #1, 
so that if n==2 we have A*(e(f)*1) =e(foh)«l. 
Finally, in suitable local coordinates on M we have 

Taf = i — (8761 + 840; — ogo), 
and direct computation shows that 

(hr (2—n) gO; . (l1SisSn). 


Proposition. If dimM—2, then for any FESH(M,M’) we have 
Vif) SH(f). Equality holds when and only when f is conformal. 


Proof. The first statement follows immediately from the inequalities (2). 
Suppose f is conformal; then for n=} we obtain 
VE) = f exp(26) ara = È elfje Ef). 
Conversely, if V (f) — E(f) we conclude that at every point. of M 
[det (Fr) g” (feg’)ay[det (gy) I. 
In isothermal coordinates on M we have 
LET) Na =— Re 
whence (f#9’)i:— (fg )z = 0 = (f#Q’)ı.. Defining 6: M>R by 
exp (20) = [det (f=g)y/det (gy) Jf, 
we obtain exp (20) gy = (f#g’)y- 


COROLLARY. If a map fo: M —> M’ minimizes V and is conformal, then 
fo minimizes E. 
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For any f€ N(M, M’) we have 
E (fo) =V (fo) SV(f) SEG). 


Remark. If M is a Riemann surface, then its complex structure defines 
a conformal equivalence class of Riemann structures. The energy of any map 
f: M— WM’ therefore depends only on the complex structure of M. 3 


(C) Harmonic fibre maps. For any map fE ¥(M, W’) and PEM we 
have the vector space My(P) = {u€ M(P): f,(P)u—0}; the vectors in 
My(P) are called vertical. Let My(P) denote its orthogonal complement 
in M(P). Suppose that for all Pe M the differential f,(P) maps Ma(P) 
isometrically onto M’(f(P)). Then f is a locally trivial surjective fibre map 
(see Hermann [13]) ; in particular, f determines an almost product structure 
on Af (i.e., the structural group On of J (M) admits a reduction to the product 
group Om X Onm). We will call a map f: M— W a Riemannian fibration. 


Remark. There are smooth fibrations f: M > M’ having no Lie structural 
group; e.g., there are non-trivial compact smooth fibrations over the 3-sphere 
S® (which cannot have a Lie structural group G, since m; (@)—=0). It isa 
consequence of a theorem of Hermann [13] that the manifolds M, W admit 
no Riemann structures compatible with f as above, for which the fibres are 
totally geodesic. 


Lemma. If f: MoM’ ts a Riemannian fibration, then for any PEM 
there are coordinate charts U and U’ centered at P and f(P) respectively, 
in terms of which f*(P) = 8% (1LSiSm,1Sa=m). Furthermore, the first 
m coordinates in U can be considered as normal coordinates in U’, and the last 
n— m coordinates are local coordinates for the fibres. 


Proof. Let (@)isn be an orthonormal base for M(P) such that the first 
m vectors span Ma(P), and the last n— m vectors span My(P). Then 
fa(P)e@ = g; (11m) form an orthonormal base for M’(f(P)), and we 
can construct the associated normal coordinates in some neighborhood U”. 
According to Hermann [13] the unique horizontal lift to P of any geodesic 
of W starting at f(P) is a geodesic of M; one determined by e, lifts to one 
determined by e We now use the local product structure to define a coordi- 
nate chart U in which the fibres have the desired property. Note that (unless 
the fibres are totally geodesic) we cannot generally require that the coordinates 
in U be normal. 


Proposrtion. Lei f: M—> MW be a Riemannian fibration. Then e(f) 
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—n/2. If for any PE M we let Fp denote the fibre through P and ip: Fp->M 
the inclusion map, then 


(f) (Q) =— fa (Q)r (ie) (Q) for all Qe Fp. 
In particular, f is harmonic if and only if all fibres are minimal submanifolds. 


Proof. In §2D we have seen that the tension field of any Riemannian 
immersion is perpendicular to the submanifold. Thus for every Q € Fp we 
have 7 (ir) (Q) € Ma(Q). If we use a split coordinate system as in the previous 
lemma, we see that 


far (in) (P)? — X 3r (ir)* (P). 


The proposition. follows by direct calculation. 


Ezamples. All covering maps are harmonic; in particular, the identity 
map is harmonic. which amounts to saying that Cartan’s vitesse is a harmonic 
1-form. If Fr(M)—M is the bundle of orthonormal r-frames of M, then 
it is known (Lichnerowicz [15]) that with its natural Riemannian structure 
on F"(M) the fibres are minimal, whence that fibre map is harmonic. Vector 
bundle maps are harmonic. Every homogeneous Riemannian fibration is 
harmonic, for the fibres are always totally geodesic, and therefore minimal. 


. 


(D) Maps into flat manifolds. Let us take for M’ the unit circle 8?; 
we will construct harmonic representatives in every homotopy class of maps 
M—&. First of all, it is well known that the set [M, 8°] of these homotopy 
classes forms an abelian group canonically isomorphic to the first integral 
cohomology group H*(M). Secondly, every such cohomology class is 
canonically represented by a harmonic 1-form on M. 


Suppose M is connected, and fix a point P,€ M. Given any such har- 
monic 1-form w on M and any smooth path yp from P, to a point P€ M, we 


define the number 
IP)= f v. 
YP 


A different choice yp of yp may give a different number f (P), but 


HP)—f(P) = f o 
YP- YP 
is an integer since the periods of œ are integral; consequently, œ determines 
& well defined map fu: M — 8! by letting fo(P) be the residue class modulo 1 
of f{P). 
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Now since fu is harmonic, every PEM has a neighborhood U in which 
df =o; thus Af—=8df-+ d8f—8e—0 in U. It is easy to see that o> fu 
establishes an isomorphism [M, 8+] == H+ (M). 

To define harmonic representatives of the homotopy classes of maps 
M — T”, the flat m-torus, we merely take m-fold products of harmonic maps 
M-— St, using $5C below; the existence of these harmonic representatives 
was first proved by F. B. Fuller [10]. More generally, any compact flat. 
manifold M’ is covered by T™, by a theorem of Bieberbach, and any homotopy 
class of maps M— M’ which can be lifted to maps M—>T” has harmonic . 
representatives obtained by composition with the projection T” —> W’. 


If M and M’ are both flat, then the only harmonic maps M —> M’ are 
those which are locally linear, as can be seen from the maximum principle. 


(E) Maps of Euclidean spheres. Let 8*(r) denote the Euclidean n- 
sphere of radius r; write 8*=—-§"(1). Then the homotopy classes of maps 
of 8" into itself are classified by their degrees. We consider now the problem 
of constructing explicitly harmonic maps of a given degree k; it is a 
simple matter to modify the following remarks to include the case of maps 
8" (r) > 8” (1). 

If (2*,- - -,2*) are Euclidean coordinates and y: Sr(r) > 8*(r’) is a 
map given by q(T, - +, a1) =— (zt /r,; > +, gr /r), then 

e(n) =n/2 (r/r)? 
We will henceforth refer points of S* to coordinates (6,6), where 6 denotes 
colatitude (0&0 <7), and ¢ a point on the equator St of 8”. Further- 
more, corresponding to the integer k let 6: 87 (r) > 8*1 (r) be the (n—2)- 
fold suspension of the map S!(r) >8!(r’) defined by ¢—> (cos kd, sin kb) ; 
since the degree is invariant under suspension, & has a k. An elementary 
calculation gives 


(a7) o(a) = EIT?) em 


We are interested in maps f: 8” — 8” of the form (8,6) > (©, $), where 
® is a function of 6 alone, and & is defined frr—=r’—=1. From (17) we see 
that on $**(sin9) we have 2e(f) = (k? + n— 2)sin?@/sin? 6, whence 


HOS Sn EO 


ZE) (sing (By de ee] dé. 


-idg 
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In case n==1 the existence and properties of harmonic maps of degree k 
is elementary. 

We now consider the case n==2 We have gu=l, gi: = 0 = gz, 
gza = sin? 6. The tension field of any map f is given by its components 


; 1 /a6\? ab \? 
7(@) = A® — sin ® cos @ le) + (2) if 


1 08 00 Ib 00 
(8) =AB+2c0t® [435 rn + FT 





For the special maps under consideration we find that for a harmonic map f 
7(®) = Ad = d*b/dg? = 0, which means that the choice 6 <= ke is compatible 
with our above selection. Substituting in the first equation we find 





1 d/. , d@ sin®cos® | 
er (an z) ang 
the only solution of 7(@) = regular at the poles is 
(19) © — 2 arc tan [c(tan 6/2)**] with c>0. 


Then d@/d6—= + ksin @/sinð, from which we ‘can conclude that E(f) 
== 4r | k |; note that it is independent of c. Finally, the integral formula 
.for the degree of a map shows that degree f == + k. We observe that for 
k—0 and all c > 0 the map is constant; for k= + 1 and c= 1 the map is 
the identity and the antipodal map, respectively. 


Remark. Although the above construction does exhibit a harmonic map 
in every homotopy class, it does not begin to exhaust their topological interest. 
For instance, with the uniform topology on (82,8%), the component 
&,(S8?, 92) of those maps of degree 0 has infinite cyclic homology: 


H, (56 0(S*, 8) ) =m (Ho(S*, 8°)) =r: (8°) = Z, 


generated by the Hopf map. A harmonic representative of that generator 
should have positive Morse index. 

Consider now the case n= 3. We do not know how to construct har- 
monic maps of degree = 2. Incidentally, the suspensions of the above maps 
(and their “compressed” suspensions below) are generally not harmonic. 
We propose now to show that the functional E: H (87, 8")—>R does not 
have an absolute minimum on the component H,(8", 8") for k 40 andn= 8; 
that this phenonmenon could be illustrated explicitly and simply by maps of 
spheres was suggested to us by C. B. Morrey. 


Let (6,6) = (®,(#),®) be the map of S"— 8” defined using (19) 
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with exponent k40. Thus for small c> 0 the map fe compresses most of 
8” into a small cell centered at the pole, and that compression takes place 
along longitudes. 
The energy integral (18) now takes the form 
Bf) FEED) fag. (EN ay 


sin 9 





For n = 3 we have 


Bf) s TEDE) Pint 0,(0) a, 


The following lemma shows that lim Æ (fe) =0; i.e for n= 3 there are 
0o>0 





maps in H,(8”, S”) of arbitrarily small energy. But for kz£0 there is no 
map fE .(8", 8") with zero energy, for such an f is constant, and therefore 
has degree 0. 


Lemma. IN sin? @,(6)d8—>0 as c—0. 
0 


Proof. For any e> 0 let p= rn —e/2. There is a number K such that 
0S (tan 0/2) SK foral 0S0 p. It follows that ©,(0)& 2 arctan (cK), 
whence there is a number ce > 0 for which 0 < sin? ©, (0) < e/2p f 0< 0S Ce 
Thus 


f’ sinto,(@)d+ f"sin*@,(6)d0< f” «/2pd04 IREE 
0 p o p 


5. The composition of maps. 
(A) The following computation is elementary. 


Lemma. If f: MM’ and f: M’> M” are any smooth maps, then 
their fundamental forms satisfy 


(20) Feet. 
COROLLARY. The composition of totally geodesic maps is totally geodesic. 
The inverse of a totally geodesic diffeomorphism is totally geodesic. 


COROLLARY. 
(21) (IE. 
If f is harmonic and f totally geodesic, then fof is harmonic. 


In general, however, we do not expect the composition of harmonic maps 
to be harmonic, as the following example shows: 
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Example. Let T? be the flat 2-torus parametrized by the angles (6,¢) 
with 0&0, p, <. Let f: Pos? be defined by 


f (0, $) — (cos 6, sin 8, cos ¢, sin $)/V2, 


considered as a point in R*. Then F defines a Riemannian imbedding of T° 
: in 8°, which is a minimal but not a totally geodesic imbedding. To see that. 
r is harmonic we show that 7(f’) is perpendicular to S° (F (P)) in R‘, and 
then appeal to Proposition 5B below. Namely, because 7? is flat we have 
a 2Fa : 
| = +5" CETER 
whence (f) (P) is directed along the radius of S* at f(P). On the other 
hand, T? is not totally geodesic in 8°, for the map f: St—> T? defined by 
f (0) == (8,0) is a geodesic of T°; it does not lie in any 2-plane through 0 
in R*, and is therefore not a geodesic of 8°. In particular, f: > T? and 
P:T?—> 8° are both harmonic maps, and their composition fof is not. 





. (B) PROPOSITION. If f: MM” is a Riemannian immersion, then 
for any map f: M>M’ we have E(f) =H (fof). The tension field r(f) 
is the projection on M’ of the tension field r(f’of). ' 


« Proof. The first statement follows from the equation 
| eP of) = 4Xa, ft oP*g”> — elf). 


The second statement is a consequence of (21); for if f is a Riemannian 
‘immersion, then the right member is the decomposition of r(f’of) into 
horizontal and vertical components because (f’ ,«g*) is the second fundamental 
form of f’. 


Conortary. A map f: M>M’ is harmonic if and only if r(f of) és 
perpendicular to M’(f(P)) for all Pe M. 


This generalizes the classical fact that a curve in M’ is a geodesic if and 
only if its curvature vector in M” is always perpendicular to M’. 


(C) Proposrtion. Let F: M’—M” be a Riemannian fibration with 
totally geodesic fibres. Then for any map f: M>M’ we have 
y map 


(fof) =f'e(r(f)). 


. This is immediate, because we can in the present situation take split normal 
coordinates in Lemma 40. 
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| Coroszary. If M == M” and f: M>M’ is a section, then Fo Far 
ts harmonic, and therefore r(f) is always vertical. 


Example. If we view a smooth r-form w on M’ as a section of the bundle ` 
J'1(M’) of r-covectors of M’, then the condition that w be harmonic in the ` 
sense of de Rham-Hodge is generally different from the condition r(w) =, 
using (say) the Riemannian structure on J'*1(M’) of Sasaki [25]. However, 
these two concepts do coincide if M’ is flat. 


Example. A map f: M->M’X M” into a Riemannian product has a 
canonical decomposition f(P) = (P(P),f’(P)) for all Pe M. Then f is 
harmonic if and only if both components f’, f”. are harmonic. For instance, 
seee Proposition 2E. 


(D) Let us suppose that W’ is a Riemannian submanifold of M” and 
that the imbedding is proper ; i. e., such that the inverse image of any compact 
subset of M” is compact in M’. Since M’ is complete, there is a positive 
smooth function p: M’—R such that for any P’ € W the set 

(Pr eM": (PLP) Sp(P)y 


is geodesically convex in M”; if W’ is compact, then of course we can suppose 
that p is a positive constant. For each P’€ M’ let Dp. denote the closed ball 
of dimension q— m (q = dim M”) consisting of all geodesic segments of length 
Sp(P’) emanating from P’ and perpendicular to M’(P’). The following 
result is well known and elementary. . 

"Lemma. Let N=U {Dp: P'E M’}; then N is a neighborhood of M’ 
in M”, and the obvious map r: N > M’ defines a smooth fibre bundle over M’ 
whose structure group is Ogm and whose fibres are closed balls. 


Taking into account Proposition 5C we have the 


Proposrrion. Let f’: M'—> M” be a proper Riemannian imbedding and 
a: N>M’ a normal tubular neighborhood. Then for any map f: M>N the 
composition mof is harmonic if and only if r(f) is vertical. 


Chapter II. Deformations of Maps. 
6. Deformations by the heat equation. 


(A) This chapter is devoted to the fundamental problem of deforming . 
a given map into a harmonic map; i.e., into a et map f:M>M’ 
satisfying the nonlinear elliptic equation 
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(1) 1(f) =0. 
We begin by discussing general methods of attack. 


The interpretation given in §2A of the tension field r(f) as the contra- 
- variant representative of the differential of E at f suggests that we try to 
invent gradient lines of E in a suitable function space of maps from M to W, 
and then to prove that these trajectories lead to critical points of E. We 
propose the following method for realizing such an attempt, which we now 
outline briefly. We do not pursue this method in the present paper, although 
the qualitative results are essentially those of the following sections. 

Let %"(M,M’) denote the function space of all maps from M to M’ 
whose partial derivatives (relative to fixed coordinate coverings) of orders 
Sr are square integrable. An inequality of Sobolev insures that if 2r > dim M 
then the maps in X"(M,M’) are continuous, and its topology is larger than 
the uniform topology. It can be shown that the space X"(M,M’) admits an 
infinite dimensional Riemannian manifold structure modeled on a separable 
Hilbert space, and that E: X"(M,M’)>R is a differentiable function. If 
= is its gradient field on ¥°(M,M’); i.e, VE(f) ——<r*(f),v> for all 
vectors v in the tangent space at f, then the ordinary differential equation 


tt (fy) 
has a local solution which is unique; furthermore, E (f:) is a decreasing 
function of ¢. Under suitable curvature restrictions the solutions are globally 
defined. If each trajectory f; is relatively compact, then it has a limit point 
a harmonic map. Thus these trajectories define a canonical homotopy of the 
initial map onto a harmonic map; moreover, such trajectories enjoy the 1- 
parameter group property. We observe that the critical points of E are just 
the zeros of all + (for any r > dim M/2). 

Now the function space ¥°(M, M’) is not a manifold, although with 
every map f we have the Hilbert space #° (f) of vector fields along f defined 
in $2A. In particular, r°(f) =r(f) is in %°(f). In analogy with the above 
outline we are led to consider the nonlinear parabolic equation 


(2) Mer) W<i<h). 


The study of this equation is our primary object in the following sections. 
We will find that the properties of the trajectories of (2) include most of 
those mentioned as belonging to the trajectories of 7” (2r > dim M). (There 
is one basic difference: The solutions of (2) are generally defined only for 
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non-negative time, whereas the trajectories of 7” are always defined for an 
open time interval around ¢—0.) 


Remark. In the calculus of variations a standard method (Morrey [19]) 
of establishing the existence of a minimum of # for a given class of maps is 
to take the space #1(if, M’) and to introduce on it a weak topology relative 
to which 1) Æ is lower semi-continuous, and 2) there are sufficiently many 
compact sets. That approach works well for dim M ==1 or 2; however, the 7 
example given in § 4E shows that it will not work in general for n = 83. 


(B) Prorosrrion. If (t,P)—f:(P) is a map of (tot) X MoM’ 
which is C> on the product manifold and C? on M for each t, and tf that 
map satisfies (2), then it is 0°”. 


We will refer to such an f; as a solution of (2). 


This follows from Friedman [9, Th. 4 and 5] provided the second 
derivatives fy“ of the f* are Hélder-continuous. But we can represent the 
local functions f* by Green’s formula, using the fundamental solution of the 
heat equation Au—éu/dt==0 as in §§ 9-10 below. The required Hölder- 
continuity is then established by standard techniques from the properties of 
the potentials involved (Pogorzelski [24], Dressel [7], Gevrey [11, No. 8]). 


(C) Let fi: M— M satisfy (2) ; the subscript t refers to the deforma- 
tion parameter (we will always indicate explicitly differentiation with respect 
to t). Then from (4) of §2B we have 


AP __ fot yel- =— f |% 


If D/dt denotes covariant differentiation along paths in W’, then for each 
PEM the curvature vector of the path t— fı(P) is given by D(0f,/ét) /dt. 


a1 . 





Proposition. If fi: M>M’ satisfies (2), then the energy E(fı) ts a 
strictly decreasing function; t.6., dE (f;)/dt <0 except for those values of t 
for which r(f}) = 0. Furthermore, its second derivatwe expresses the average 
angle between the tension field and the curvature vectors of the deformation 


paths: 
Ds, RE) ran 


Lemma. Let fi: MM’ be an arbitrary deformation for tE(t,h)- 


If we let 
a rfe +r a Of Of? 
A at) T azt m“ bat Ot ? 
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then 
BE (fr) D/A, D (of “ns 
Se P) Pats = | 
D 
-f gR auprfu fut te dr +1 u‘ ote (ft) yL. 


"This follows from a direct calculation of ée(f;)/dt? and an application of 
Green’s divergence theorem. 

Because the first integral of the right member is always non-negative, 
we have on appeal to the above proposition the 


THEOREM. If fi: MM’ satisfies the heat equation (2), then 
4 a8 @E (fe) -Í gel ti) D (2) 
m I< Gat Vet)? Ga ae 


aa GE cppef wo feh ie Mr *l. 


In particular, if M’ has non-positive sectional curvature, then dE (f;)/dt? = 0. 
If i is a value for which equality holds, then r(fı) is a covariant constant; 
1.6, 


š aa (AE) o for all Pe M and (S150). 


(3) 





at 


COROLLARY. If M’ has non-positive sectional curvature and tf f; satisfies 

(2) for all tÈ to then , 
AG), 0 as to. | 

(D) We have seen in 85 that in supposing M’ contained in a larger 
manifold W” we do not alter the energy of a map f: M>M’. That suggests 
that we still have control of the energy and the tension of deformations of f 
which take place in a normal tubular neighborhood N of W in W”. 

If f: M’— M” denotes the imbedding, then the induced tangent vector 
bundle is "I (M’) = J (M) ON (M”, M’), where the second summand is 
the normal bundle of M’ in M”. Then T— M is Riemannian-connected in 
the sense of $3A. There is a canonical vector field p: N>N covering the 
projection map +: N—> W defined by assigning to each Q” € N the unique 
vector p(Q”) € M” (#(Q”)) such that expec”) (p(Q”)) = Q". 

-Suppose now that f+: M>N is a smooth deformation (to & t< t). 
Then p0 f; is a vector field on the map ro fr, and using the harmonic integral 
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theory of § 3 applied to the vector bundle N — W’, we can define its Laplacean 
A(pofı). Let 


- ~ D 
L(po fi) =A (e° fi) — (poft), 
where D/ôt is the covariant derivative in N along the path ~o fs 
We now establish the following stability property of deformations. 


THEOREM. Let N be a normal tubular neighborhood of M’ in M”, and 
suppose that fs: M—>N is a smooth deformation (toS t< t). If L(pofi) 
is always horizontal in J (Mt) and if fn: M>M’, then fi: M>M’ for all 
bo Stich, 


Proof. We apply Green’s theorem to u,v€ A°(M, (rof) N): 
f <u, ivs =— f <du, dvy*1. 
M M 
The hypotheses imply that <pofs,L(p°f;)> =O for all ¢, so that 


=f eof itti f <p° ft, D (of) `l. 
Therefore 


h, LPO fipo fiy tl = EE 
—— f ld(pofp terse. 


I.e., f, |pofil?*1 is a non-negative, non-increasing function of t, and it 
M 


is zero for t=t,. We conclude that pof,;==0 for all %=¢< h, which states 
precisely that every f; maps Af into W. 


7. Global equations. 


(A) We now occupy ourselves with the problem of replacing equations 
(1) and (2), which in terms of local coordinates on M and M’ are local 
systems of equations, by some much more tractable global systems. 


Remark. Assume for the moment that we have an isometric imbedding 
w: M’— Ra for some q, which we can always do by a theorem of Nash [21]. 
Then as in Proposition 5B we find that equation (2) is satisfied for a deforma- 
tion f;: M—> M’ when and only when the composition W;— wo f; satisfies the 


condition that the vectors LW, AW, — Et are perpendicular to MW’; 
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Lemma YB below. When expressed in terms of the coordinates of R«, that 
condition gives rise to a global parabolic system of equations of the type (2). 
On the other hand, the assumption of an isometric imbedding apparently 
affords no real simplification in our theory, and we will not make it. We 
proceed with an elementary imbedding convenient for our purposes. 

Suppose that M’ is smoothly and properly imbedded in some Euclidean 
space Re by a map w: M’>Ra. 

Lemma. Given such an imbedding of M’ in Re, it is always possible to 
construct a smooth Riemannian metric g” == (gap) 150,teq on a tubular neigh- 
borhood N of M’ so that N is Riemannian fibred. 


Proof. Let N be any tubular neighborhood of M’ constructed using the 
Euclidean structure of R4; let m: N — M’ be the projection map. It suffices 
to construct an appropriate smooth inner product in each space R«(P’) for 
all P’€ M’, for we can translate that tangent space to any point Q’E N along 
the straight line segment (necessarily contained in N) from P ==r(Q) 
to Q’. We take g’ in M’(P’) and the induced Euclidean metric in the 
(Euclidean) orthogonal complement of M’(P’) in R¢(P’), and take their sum 
in Ra(P’). 

In terms of local coordinates (y*,- --,y™) on M” that metric can be 
described as follows: Write w(P’) = (w!(P’),- + +, w%(P’)); then 

a Bw Gul 

2 a yf 
is the metric on M’ induced from the Euclidean metric. Let t” be the unique 
solution of 





ur? Ow? wt 
2a Bye aye T 
.__ dw® ; . ; 
We have the duality relation pah T A, and the metric tensor is 
j q Ow? aw? 
To dan — 2 Bye a +o apta tP. 


Then 


„ Ow dw® 
g ob pya ys I A 


so that g” does induce g’ on W’. For any vector veRe(P’) satisfying 


q 
I —0 (Sas m) we have $ vta =0 also, so that 
ai 


a Ô 


b 
Zee m 0 and a2 (0) 
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Thus g” has the desired properties. 


(B) Lemma. Let fi: M>M’ be any smooth deformation, and let 
Wi: M>N be the composition w of: =W; Then r(fı) = dfı/dt if and only 
if +(W;) —0W,/dt is perpendicular to M’(f;(P)) for all PEM. 


Proof. The argument is essentially that of Proposition 5B; we choose 
local coordinates on M’ and obtain 


A ö . E 
En 
un (WF). 


In terms of the coordinates of R@ the differential of the projection map 
x: N— M’ has components r? = br°/dw*. Its covariant differential in terms 
of the metric g” is 
83° 


= wow? — TI” gp bra? (13a, bes q). 


Tab? 
The map p: N — R¢ defined (as in 86D) by p(Q’) = Q’—7(Q’) assigns to 
each Q’E N a vector perpendicular to M’(”(Q’)), and pa? + ma? == 84°, 
par? + an? + Io? = 0. 
For its restriction to M’ we obtain 
Pr? Fx? 
ses Oo He 


where wat = 6w*/dy*. For each a, £ the right member defines a vector per- 
pendicular to M’; because the wat span the tangent space to M’ in which 
they lie, we obtain the 





— par wtw? = 


Lemma. For any vectors u,v € M’(Q’) the vector whose components 
are pap u? is perpendicular to M’(Q’). 


Lemma. For any map W;: M—>N with image in M’ let E be the vector 
with components 
E = LW — ma Wie Wagt, 
where L == A—6/8t is the heat operator on M. Then & ts tangent to M’. 
Proof. As in Proposition 5B we have 


2 8 
L(o(W:))¢— poll (Wi)? + oe 





WW yg 
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(5) 





== pL (Ws)? — WW gt 


2 


But p(W:) = 0, whence the left member vanishes. Since the second term in 
the right member is a normal vector, we have 


pL (Wi) = po? may Wa Wig”. 


Fr? 
dene 
It follows that 

poé? = (po? mn y — potron) Wae Wig! = 0 


for 1Sdxq. Thus & has normal component 0. 

Proposrrion. A map f: M—> W satisfies (1) if and only tf the com- 
position W==wof satisfies 
(1) AW? = ra WEW gts 


in terms of local coordinates on M. 


A deformation fi: M—>M’ (to <t<t,) satisfies (2) if and only if 
W= wo f; satisfies 


(2) L(W) = ran W neW itgi (<t t). 


Proof. It suffices to establish the equivalence of (2) and (2). For 
that we take any deformation f; and compute 


= (LM) + La Wi Wig) g cate? 
= (L(Wi) ° — ra Wa Wisgi) g” cay’, 


by the second lemma. If W, satisfies (2), then 7(W:) (P) —aW;(P) /ét is 
perpendicular to M’(f,(P)), whence by the first lemma f; satisfies (2). 
Conversely, if f: satisfies (2) and we define é as in the third lemma, then 
our equation shows that £(P) is perpendicular to M’(fı(P)), whence it 
must be 0. 


(C) The following result is an application of Theorem 6D. In order 
to have a proof avoiding the use of vector-bundle-valued harmonic forms, we 
can start with (5) and substitute (2) to obtain 


(r(W:)°— 





Prt A 
L(p (Wi) ) = + ee at) Wa Wah, 


using the projection relation pa°r,? — a°pe®. It follows that p°: L(p(W;))? = 0, 
so that 
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ð ; 
ZA) =t 2 (e (W:)°)*. 
Applying Green’s identity (as in Theorem 6D) we find that 


taf e= f, (eram, 


and the use follows: 


Trrorem. Let W,: MN be a smooth deformation satisfying (2) for 
WSt<t. If Wu maps M into M’, then so does every Wi(tp St < h). 


8. Derivative bounds for the elliptic case. 


(A) Under suitable curvature and metric restrictions on M’ we shall 
establish derivative estimates important for the solution of (1) and (2), or 
equivalently, of (1) and (2). Our starting point is the following result, 
essentially established in § 3C. 


Lemma. Any solution f: of (2) has energy density e(fı) satisfying 


felis) 


Ae (fs) — =| 8 (fi) |? —PapyeftfyPfarferg*g? 


— gar RY, 


where B(f;) is the fundamental form of fı and where R’agys and RY are the 
components of the Riemannian curvature tensor on M’ and of the contra- 
variant Ricci tensor on M, respectively. l 


OB 


(B) For the elliptic systems (1), (1) we invoke Green’s formula for 
the operator A on M. Let r(P,Q) denote the geodesic distance between 
points P, Q of af. Since M is compact (without boundary), there is a constant 
@> 0 such that r?(P,Q) is of class C” for r(P,Q) < 3a. Let (À) be a 
monotone C* function in OSA <œ with (A) =A in OSASa and ¢$(A) 
= constant for A>2a. Set p?(P,Q)—¢(r(P,Q)); this is positive for 
P=£Q and is of class C”. The function 


F (P,Q) —n-p(P,Q)-™ Ser log p(P,Q) for n=?) 


is a parametrix for the operator A, where 1/x is (n— 2) times the surface of 
the unit (n—-1)-sphere. Green’s formula is 


() u(P)= f [u(Q) AF (P, Q) —F(P, Q) -Au(Q) Ilo 
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this holding for any function u(P) of class C? on M (see Giraud [12], Bidal- 
de Rham [i]). 

Consider now a solution of (1), and suppose that the Riemannian curva- 
ture of M’ is non-positive. From (6), in which it is merely necessary to 
suppress the term de(f;)/dt, there follows at once 

. e(f) =2—Re(f), 


where R is a constant (independent of the solution in question). Since 
F(P,Q)=0 (a and ¢ being suitably chosen for n==2), (7) applied to e(f) 
yields 


olf) (P) S J LAP (P,Q) +2-F(P, Q)1e(f) (Oele. 


By using the osculating Euclidean metric at a point of M one can show that 
| AgF' (P, Q)| S const. X p(P,Q) =. Hence for some constant A, 
elf (P) SA f F(P,Q)0(f) (Oele. 


Iterating this k— 1 times we obtain 


e(f)(P) SA¥ f FP, Q)e() (Ort. 


where the F are defined inductively by F, =F and 


FB) f Pea (P, 2) Fa, Q)e1r (k>1). 


Ii k > n/2, then Fy is bounded (see Giraud [12]), and we have the following 


THEOREM. If M’ has non-positive Riemannian curvature, then there is 
a constant C such that e(f) <C-E(f) for any harmonic mapping f: M — M’. 


(C) Green’s function G(P,Q) for A can be written in the form 
G(P,Q) =F (P,Q) + F (P,Q), where F’ is of class 0” for P54Q and has 
a singularity of order lower than that of F for P=Q (Giraud [12], Bidal- 
de Rham [1]). G(P,Q) is symmetric and of class O* for P34 Q and satisfies 
ApG (P,Q) =AgG(P,Q@) = V+, where V is the volume of M. Green’s 
formula (7), with @ in place of F, is 


(8) uP) = 77 f of GCP, @) -Au(Q) ete. 


Now let Ü be a compact coordinate neighborhood on M, U its interior, 
and let PE U have coordinates (21, > -,2”). Write 


HARMONIO MAPPINGS OF RIEMANNIAN MANIFOLDS. 143 


G(P,Q) = 0G (P,Q) /éxt; Gy s(P,Q) = PGP, Q) /dctoat 


Using normal coordinates on M one can show that there is a constant O such 
that 

| G(P,Q)| SC-r(P,Q)™ 
(9) | Gy(P,Q)| SC-r(P,Q)” 

| (P, Z) —G(Q,2)| SO-r(P,Q)*[r(P, Z) + r (Q, Z) me] > 


for P,Q €U, « being an arbitrary but fixed number with 0 <a <1. 


If u is a solution of Au=f on M for some function f, then from (8) 
we have (for PEU) 


u(P)=— f (P, Z) :f(2)*1z 
Hence 


|u(P)—u(Q)1= f | RD — 9,2): LAZ) | de 


for P,Q€U. Using the last inequality of (9) we obtain 


(10) | —u(Q)|:r(P,Q) =S 0 eup |f |, 
where 


Cm C-sup f, [BZ hr (Q, Z) Jalg, 


Suppose now that f is Hölder-continuous with exponent « and Holder moduius 
Malf). Ie, Malf) up [f(P) —f(@)|-r(P,Q)*. It is a classical result 


of potential theory that the function 
fi (PZ) P.) De (P, PaE U) 
has a derivative with respect to a/ at the point Po, given by 


SP» 2 “Lf (Ps) FZ) a 


and by (9), this integral is majorized by 
O- Malf): iR r (Po Z)-™* a1 y, 


On the other hand, the function $(P) -f G(P,Z)+1z is a constant, since 
M 


Ag—0, and go f G (P, Z) -f(Pa)*1z—0. We conclude that 
M 
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(11) | Pu/dxtded | S C- Malf) in U. 


(This is an interior estimate of the type given by Hopf and Schauder (Hopf 
[14], Schauder [26], Miranda [18]), but differs from them in that the 
magnitude of u is not involved.) 


(D) We apply these results to a harmonic mapping f: MM’. Denote 
„the right member of (1) by Fe: 


Fe = raa WEW pg. 


At this point we impose some boundedness conditions on the embedding of M’ 
in R, conditions which are automatically fulfilled if M’ is compact. Namely 
we assume that 

| av? | E Co, |dra/öw|<C, on M’, 


i Aids? < å? < Aids, 


where Oo, A1, A, denote positive constants and where ds? denotes the line 
element induced on M’ by the usual metric in Rs. 

Again let U be the interior of a compact coordinate neighborhood on M, 
and let P, Q be points of U. From (12) and an elementary calculation 
involving the Schwarz inequality for quadratic forms and the equality 
e(f)P =g" aW eW Pg, 

| Fo(P) — F" (Q)|-r(P, Q)" 
a | SB- [e+ Amp | Wa (P) —We(Q)| :r(P,0)*], 


where B is a constant and é= 6(f) —sup{e(f) (P): Pe M}. From (1) and 
(10), 
| We(P) —We(Q)|7(P,Q)*SC' eup | F°], 

and plainly | F*|< const. X 3, in virtue of (12). From the compactness 
of M there follows the estimate 

(14) Ma(F°) SB’(é+@) 

for the Holder-modulus of F°, B’ denoting a constant. Referring to (11), 


we have the 


THEOREM. Suppose that M’ satisfies the embedding conditions (12). 
Let U(z*,- > -, a) be the interior of a compact coordinate neighborhood on 
M. Then there is a constant O such that 


|West! | SO (E(f) +3) in U, (1SaSq), 
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for any harmonic mapping f: M>M’, where é(f) =sup{e(f)(P): PEM}. 


Remark. We point out that second derivative estimates can be obtained 
from linear theory in another way. Namely, if we write our equation (1) 
in the form 


AWe+ AIW p == 0, where Ap% = — aa Weg”, 


then we have a linear system with bounded coefficients (in compact coordinate 
neighborhoods), by Theorem 8B. A Hölder-modulus for the W,° will then 
give us a Hölder-modulus for the coefficients of the linear system, and we can 
apply Theorem 1 of Douglis and Nirenberg [6] to deduce second derivative 
estimates and analogous estimates on all higher derivatives as well. The second 
derivative estimates we obtain here are somewhat sharper, in certain respects; 


i.e they do not involve a priori estimates on the magnitudes of the solu- 
tions W°. 


9. Bounds for the parabolic case. 


(A) We now embark upon some analogous computations for the operator 
L=4—9/t. The function 


(15) K (P,Q, t) = (2V r)i? exp(— p*(P, Q)/4t) 
is a parametrix for the operator L (p? as in the preceding paragraph). Put 


N (P, Q, t) = DpK (P,Q, t) a (Ap — 6/8t) K (P, Q, t) 
and 


N,(P, Q) = [dr f Napa) nz, Or Kl: 


It is well known that there exists a fundamental solution H for the heat 


operator L on any compact Riemannian manifold M, which can be expressed 
in the form 


(16) H(P,Q,t)—K(P,Q,t) + fdr ERB t=) N (Z, One 
where 


N(P, 0,1) =È N(P, 0,2). 


(See Milgram-Rosenbloom [17], Pogorzelski [24]). The function H (P,Q, t) 
is symmetric in P, Q and is positive. Itis of class O” except for P = Q, t==0; 


10 
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and it satisfies DpH (P, Q, t) = LeH (P,Q, t) —0. Its spectral decomposition 
‘a : 


H(P,Q,t) =V + = exp(—Art)o(P) $5(Q), 


where the A, are the non-zero eigenvalues of A, the ¢,(P) being the corres- 
¿ponding orthonormal eigenfunctions. 
Green’s formula (analogous to 8) is 


$ 
u(P,t) =- f dr f H(P,Q,t—r) -Lu(Q,r)*1q 
(17) to M 
+ f, H(P.Qt—t)u(Q,t)ele (h<i<h), 
this holding for any function u(P,¢) on M which is of class C? in P and C 
in ¢ for Eb St< ty. 


(B) Suppose now that we have a solution f;: M —> M’ of (2) defined in 
0<t<t, and let W’ have non-positive Riemannian curvature. According 
to Lemma 8A we have then Le(f) =—-Re(f;), E being a positive constant 
(independent of the solution in question). Since H > 0, there follows from 
(17) 


18) of) (P) SRS d f E(P, Q,t—7) et) (Q) + alt) (P) 


where 


(19) e(t) (P) = f H(P, Q,t—ts)e(fa) N rle 


and 0 <t,<t<t, Iterating (18) k—1 times we obtain 


o(fi)(P) ER arf’ He(P,Q,t—r)o(fx) (Oele 
(20) 


+ eo (fi) (P) +SP für Í. H, (P,Q, t—7)eo(fr) (Q) 1a 


where the Hy are defined by H, =H and 


t 
H,(P,Q, t) = f. dh f HP DEZ  (k>1). 
o 4M 
From the integral representation it can be shown (see Pogorzelski [24] ) that 
H(P,Q,t) = const. X tr (P, Q) (0S¢531). 
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where « is an arbitrary but fixed positive number less than 1. Therefore Hy 
is bounded for k > n/2 ((<t<1,k>1).' . 

Consider now our solution f; for ¢>1. Putting t—1 for tẹ in (20) 
we have 


elf) (P) S const. f def e(f.)(Q)#1 


(21 k-1 1 ~ l 
+eup elf) (P) HSR f d f E(P, Qt). 
M val o M 


For the case at hand, eo is given from (19) by 


eh) (P) = f H(P,Q,1) el) (Q)#le. 
Since H(P,Q,1)-is bounded, we have &,(fı) (P) < const. St (Q) #1¢. 
Recalling that f, e(f:) (Q) is a decreasing function, we obtain finally from 
(21) l | 

e(f:) (P) S const. Se (Q)*1 (>1). 
Any smaller value can be put in for t—1 on the right, for example zero if 
e(f:) (P) is continuous at t==0. l 


Making that assumption, we now obtain an estimate for the range 
O0StS1. In (20) we now put te= 0, getting 


(22) (fs) (P) Soonst. f "dr f eA (Q)41-+ 4H], 


where now we have i 
eh) (P) = f° E(P, Q, telf) (Q)*1os 


and where é)(f;) =sup{&(fı) (P): PE M}; we define &(f;) similarly. But 
this function is precisely the solution of Le,=0 that reduces at t==0 to 
6(fo)(Q). From general principles it follows that eo(f:) (P) Sé(fo) for 
t= 0, and so (22) gives at once 


e(f:) (P) S const. ë (fo) (0<tS1). 
We have then the 


THEOREM. Let fi: M>M’ be a family of mappings for OSt<h 
- satisfying (2) for 0 <t<t, and such that the energy density e(f:)(P) is 
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continuous at i= 0. Suppose that M’ has non-positive Riemannian curvature. 
Then 


DISS, A fortSt<h 
and 
st) (P) S0- sup(o(fo) (Q): QEM) for 0S#S1, 


C denoting a constant which does not depend on the particular solution fi 


of (5). 


Remark. Under certain circumstances much sharper estimates can be 
obtained. With the hypotheses of the preceding theorem, assume further that 
the Ricci tensor of M is positive definite at every point. From (6) it is clear 
that ĝe (fi) /ét S—As(fı) at any maximum point of e(f;) on M, A denoting 
a positive constant. It follows easily that e(fı) (P) S const. e4*, 


(C) Now let (2%, - -,z") be the coordinates of P in the interior U 
of a compact coordinate neighborhood U on M. And suppose that our solution 
of (2) and the first-order space derivatives are continuous at t=-0. Then 
from (2), (17) we have 


W: (P) —W°(P,t) 
(28) (af, BR -Fo(Q,2) Hot Wo(P,t) 
= Ve (P, t) + Wo (P, t), l 


where 
Wo (P, t) = f H(P, Q, t)We(Q,0)*La, 
M 
the F° (P, t) being the functions on the right of (2). 


The first integral V° (P, t) has Hölder continuous first-order space deriva- 
tives (Pogorzelski [28], Theorem 5): 


| Vae (P, t) — Ve (P’, t) | S const. sup | F° |- [r (P, Pe + | t—# |2], 


æ being an arbitrary positive number less than 1, the points P and P’ both in 
U. If we continue with the assumption (12), we shall have | F° | < const. X 8. 
The integral W,°(P,t) can be differentiated under the integral sign (for 
t>0) and the derivatives tend exponentially to zero, as is quickly seen from 
the spectral formula for H. Hence, if the hypotheses of Theorem 9B hold, 
it follows that the functions We(P,t) have first-order space derivatives which 
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are Hölder-continuous in P,t, uniformly so for t2«>0: 
| we(P,t) — We (Pt) 
= const. [ë (fo) + sup | W°(Q, 0) |] -[r(P, P’)*-+ [¢—# |*°]. 


(The constant depends upon e because of the behavior of W,°(P,#) for 
small t.) 


Referring to (13) we see that 


(24) | Fo(P,t) —Fe(Q, t)|-r(P,Q)* 
const. 8(f) [1 + 8(fo)#+ sup | #°(9,0)|] 
for tZe>)0. 


g x 
Now from (17) it is clear that Í dr f H(P,Q,t1—r)y(r)#1g is a 
° M 


function of ¢ alone for arbitrary y. Hence for the second derivatives 
- Vaze (P, t) = V9 (P, t) /bxtzi we can write 


VB) mg J dr SER WIN LP Por) —F°(Q,7) Jee 
From (Pogorzelski [24], Th. 3) this is 


Vas (Pit) = de f Has(P,Q,t—r) Por) — F(Q, 1) Ila 


- f font 


where we assume t= 2e>0. The integral I, is improper but uniformly 
convergent. Now |H,;(P,Q,t)| < const. X tPr(P,Q)"**P (arbitrary £, 
0<8<1). Using (24) and putting P == P, in I, (we assume (P, P.€ U), 
we obtain an absolutely convergent integral if a, 8 are chosen properly, and 
there results 


|Z; | < const. ë (fo) [1 + sup | W° (Q, 0)| + 8(fa)#] it t= 26 


since then r in I, will be =«. For I, we have | H,,(P,Q,t)| < const. e7 for 
some positive y and for Z2e>0. Hence 


3 
| Ia | < const. sup | F° | S TAEA de 
0 


< const. sup | F° | < const. ë (fo), 
using Theorem 9B. 
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THEOREM. Suppose that M’ satisfies the imbedding conditions (12). 
Let f; satisfy the conditions of Theorem 9B, and let (a1,---,x") be the 
coordinates of a point P in the interior of a compact coordinate neighborhood 
U on M. Given «> 0, there ts a constant O, independent of the solution fi 
of (2), such that 


| < C- (fo) [1+ 6(fo)# + sup{| W°(Q,0)|: Q € M} 





for Ze, where é(fo) == sup{e(fo) (P): Pe MY. 
Remark. Since f H(P,Q,t)#1q is a constant, the functions W(Q, 0) 
M 


appearing in the foregoing estimates can be altered by arbitrary additive 
constants without affecting the validity of the estimates. For example, one 
could replace W°(Q,0) by the function minus its average value, say We, with 
the result that the term sup | W°(Q,0)| in Theorem 9C would be replaced 
by sup | W°(Q,0) —We |. 

10. Successive approximations. 


(A) Let W(P,t) and W’(P,t) be two solutions of (2) in 0St< t, 
both continuous along with their first order space derivatives at t==0; and 
suppose that W(P,0) == W’(P,0) € W for all PE M. From (17) with t = 0, 


W(P,t) — W(P, t) 
t 
=— f af A(R, Qtr) L(G.) —P” (9,7) +o, 
where F°, F’ are the respective right members of (2). Set 
Z(t) = mp | We(P,t) — W(P, t)| 
TIEF get 
10 

From the constitution of F° and F’e it is easily verified (by an argument 
similar to that for (13)), account taken of (12), that 


| Fo— F" | < const. X (t) -U (t), 
where 


U(t) =ë (fi) Hefe) +EH E. 
For OS ¿S1 we can write H (P,Q, t) < const. tr (P,Q)*?= and 
| 3H (P, Q, t) /6a* | < const. t*r (P, Q)-"- 24 (0<a<1), 
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where in the latter the constant depends upon the particular choice of local 
coordinates z*, of course. Now let A denote an upper bound for the quantity 
U(t) in some fixed time interval 0 S tS ta From the integral expression 
above there follows easily, for $ < a < 1, 


X(t) < const. X A f EERO dr, 


and we conclude that X (t) vanishes for small ¢t Hence the 


THEOREM. Let f: and Fs: be two solutions of (2), both continuous along 
with their first-order space derivatives at t==0. If fo—=f'o, then the two 
solutions coincide for all (relevant) t> 0. 


COROLLARY. Any solution of (2) enjoys the semi-group property along 
the trajectory of each point PE M. That ts, tf we write fı(P) =T;(f ), then 


Tur (fo) = Li (fr) = Ti (Tr (fo) ). 


(B) For the solution of (2) we now turn to the system of non-linear 
integro-differential equations (23) associated with (2). 


Let f: M— W be a mapping of class 0", given by global mapping fune- 
tions W == (W+, - -,We). For v0 define W” = (Wr,. - -,Wr@) by 


(25) W(P, t) — | H(P,Q,4)We(Q)+1g 
and 

Wro(P, t) 
(26) 


—— f "er J H,(P, Q,t—r) - F70 (Q, t)*la + W(P, t), 
0 M 


where 
F” (P, t) = na (W°) - WPEW Ptg, 


the functions zap? as in (2). Set 
q 
Y» = sup [ > WyPew progts ji, 
M ol 
From (26) 
Wye (P, t) 


A D S, ar HP, Q,t—r) Pr (Q, r)*lo + W(P, t), 
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where the subscript ¢ denotes differentiation with respect to a system of local 
coordinates zt at P. We recall the estimate 


| Hi(P,Q,t)| <<Ater(P,Q) we (OStS1;$<a<l), 


A denoting a constant which depends in general on the local coordinate 
system. Now let B denote an upper bound for the quantities |mas? | in some 
compact neighborhood U’ of the image f(M) in the tubular neighborhood 
NCR. Jf We U’ for 0StSe, then from (27) we conclude that 


Ue <BO (wert) (0<tS0), 


where C is a constant which does not depend upon the given mapping f. Put 


Y, = SUP Y», 0S:Se 
Then 
9 < Kéis? + Go K = BC/(i—a). 


If Keg,,<} and Key, <4, then 
Key, S (Ke*9,.1)* + Ke Sf. 


From a transparent induction it follows that, for sufficiently small positive «e, 
we shall have 


Wr(P,t)E U’ and 9, S4K 6“ for 0 StS e v—0,1,2,---. 


In particular, the defining equation (26) makes sense for all v, provided 
0StS« 
Now put 


X,(t) = sup | W” (P, t) — Wr (P, t)| 
Mie 
+ [sup (Wee — Wyte) (Wee S3 Wyre) gh, 
M,o 
From the definition above, 


fro Fre — aap? (W**) (Weewp? = Wypraw pt) g” 
+ [ras? (Wr) eis Tab? ( W») ] Were pgti, 


We can suppose that the constant B occurring above is also an upper bound 
for the quantities | Öman°/dw | in the neighborhood U’. The preceding formula 
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then gives us 
| Fro prio | < CBX: (H+ Ira + Y) 


0’ a constant independent of the given mapping f. Hence, 
| Feo. Prwe| < O/BX,[1/Ke* + 1/4042 2°] — O” X, (t). 


From (26), (27) and the estimates cited for H (P,Q, t) and H,(P,Q,t) we’ 
obtain 


Z,a (t) < DO f z) (dr) dr CERED 


where D is a new constant. Thus if 


2,(t) =supX,(r) (ISTS$t), 
then 
Blt) < (Pr) 20) Ve; 
and so the series 
2%, 


converges for all sufficiently small ¢. This shows that our successive approxi- 
mations W” and their first-order space derivatives converge uniformly on 
M (for small ¢). Hence, the F*° also converge. Set W°—1lim Wr and 
F° = lim F>” (yc). Thus We(P,t) has continuous first-order space 
derivatives W,° (for sufficiently small ¢, of course), and We > W,° (yoo), 
so that 


Fe (P, t) = Ta? (W) WeW pg. 


From (26) there follows at once 


(28) W(P, =— f dr f H(P,Q,t—r) -Fe(Qpr)eig+ WP, t). 


We conclude that the functions W° have Hölder-continuous first order space 
derivatives—uniformly Hölder-continuous for any small closed ¢-interval 
not containing zero. Therefore the functions Fe(P,t) are Hölder-continuous 
with respect to the space variable, and so the functions W° of (28) satisfy 
equation (%) for all positive ¢ in the interval in which the successive approxi- 
mations converge (see Pogorzelski [24]). The We are moreover visibly con- 
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tinuous with their first order space derivatives at t = 0, and W°(P, 0) = W°(P). 
From Theorem 7C we recall that the point W(P,¢) = (W',- - +, W4) must 
lie on the manifold M’ for all ¢ in the interval of convergence. 


THEOREM. Let M” be a compact subset of MW. Then, for any con- 
tinuously differentiable mapping f: M>M’ such that f(M) lies in M”, 
- there is a positive constant t, depending only on M” and the energy density 
e(f) such that (2) has a solution fi for OStSt, which is continuous at 
t==0, along with its first order space derivatives, and which coincides with 
f att—0. 


It only remains for us to inquire into the length of the t-interval for 
which the successive approximations converge. First of all, the upper bound 
B for | ma | and | @rqx°/dw*| figuring in the foregoing proof can be taken 
once for all to be valid in some neighborhood U” of M”, ‘Therefore the 
constant K can be fixed, and a as well, of course. The e must satisfy 
Key, S 4, and to see what this entails we must look briefly into %.. 

Consider then a solution u of the heat equation on M, as a map 
u: M>R. We suppose that u and its first order space derivatives are 
continuous at ¢=-0. The argument of Theorem 9B holds in this situation. 
If we put p= gumy, then p(P,t) SC sup{p(Q,0): QEM}, where C is a 
‘constant depending only on M. Applying this to the functions W%e, we 
conclude that there is a constant C, such that Yo < Cı:ë(f). Thus e depends 
only on M” and the magnitude of e(f), and the same is true of the quantity 
O” involved in the estimates of the Y,. The assertion of the theorem then 
follows at once from those estimates. 

In §2B we described the harmonic character of O? maps in terms of 
their tension fields. For C* maps we have the 


COROLLARY. Let f: MM’ be a continuously differentiable mapping 
for which the energy ts a minimum with respect to small variations. Then 
f is harmonic. 


For let fs be the corresponding solution of (2) guaranteed by the pre- 
ceding theorem. The energy E(f) is continuous at = 0 and by assumption 
it must be non-decreasing for small t. But E(f:) is always non-increasing, 
so that dW/dt=0 for small t. Thus (2) reduces to (1). 


(C) Tueorem. Suppose that M’ has non-positive Riemannian curva- 
ture, and that it satisfies the embedding restrictions (12). Then for any 
continuously differentiable mapping f: M— M’ there is a unique solution fi 
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of (2), defined for all t= 0, which is continuous along with its first order 
space derivatives at t==0 and which coincides with f at t—0. 

Such a solution exists for small ż, by Theorem 10B, and it is unique, by 
Theorem 10A. Let t, be the largest number such that a solution of the 
required sort exists for OS t< th, and supposes that ¢, is finite. From 
Theorem 9B it is clear that the right members of (28) cannot become 
unbounded for O0S¢t< tı and consequently the images f;(M) (OSt<1,)° 
all lie in a compact subset of M’; we recall that M’ is always assumed to be 
complete. On the other hand, Theorem 9B shows that the energy density 
e(f:) remains bounded, and therefore by Theorems 10A and 10B there is a 
fixed positive number e, such that any f; can be continued as a solution of 
(2) into the interval (t, t-e). This contradicts the definition of t. 


(D) If M’ is not compact, then solutions of (2) may very well neue 
unbounded as i>o, as in the 


Example. Let M’ be the manifold obtained by revolving the graph of a 
positive strictly decreasing smooth function v—v(u) around the u-axis; let 
p denote the revolution angle. For a map f: SM’ of a circle S* para- 
metrized by the central angle 6 our heat equation is 


ðu _ vo” (ou 
a = ta: 1+ wP (Ft) — 1+ (wv)? ($ 
bp _ v du Ob 


ne tS 
If f satisfies initial conditions ĝu/ĝ0 = 0, p =} when t==0, then so does the 
solution fp for any subsequent time. If we take v(u) =1I--6e*, then 
Rin = — (e* +1)/(e 4+1) <0, and the heat equation reduces to 
ĝu etl 


A epil’ 





Thus e#-+ u—2log(e*+ 1) —¢-+-const.; in particular, u>w as t—> o. 


We note in passing that there are no non-trivial closed geodesics on M’, 
so that there are no harmonic representatives in any non-trivial homotopy 
classes of maps St-> M’. 

The following result shows that solutions must remain bounded if M’ 
satisfies certain conditions at infinity. 
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THEOREM. Let M’ be as in the preceding theorem and suppose further 
that | w |- ma (w) > 0 uniformly as |w| >», where | w| =sup| w° |. Then 
o 


every solution of (2) is bounded. 
Set 
W(t) —sup | W(P, £), YO) = int | Wo(P,t)|, T = JE m. 


In virtue of Theorem 9B, the difference W (t) — W(t) is bounded. Hence 
if our solution is unbounded as too, then that is true of all three of the 
quantities above. Supposing that to be the case, let us denote by A, the set 
of all ¢ for which U (ż¿) >k. The A; are then all non-empty and each A, must 
contain at least one tt, at which dU/di>0. Now from (2) we have 


awe 
dt 





E WeaWe— ZW mS Wera WW eg. 


Hence by Green’s Theorem 
fa /dt——{ (grad WE S Were Wa git. 
M ov M 


For large values of t, we have a plain contradiction, since the right-hand side 
must be negative. 


11. Harmonic mappings. 


(A) We can now apply some of the results established above to prove 
the existence of harmonic mappings, even though we do not know whether 
the solutions of the parabolic system (2) converge in general as t> œ. 


THEoREMm. Let M’ have non-positive Riemannian curvature and let 
fi: M>M’ be a bounded solution of (2), O<t<o. Then there is a 
sequence ty, ts, ta, >- of t-values such that the mappings fi, converge uni- 
formly, along with thew first order space derivatives, to a harmonic mapping f. 


From Theorems 9B and 9C it is clear that the mappings f; and their 
first order space derivatives form equicontinuous families. Hence there exists 
a sequence tı, ta - - such that the mappings fr = ft, converge uniformly, with 
their first order space derivatives, to a continuously differentiable mapping f. 
From (2) and (8) we can represent the fẹ by the formula 


W(P, te) = [We Ff GP, OLO te) + (Q, ty) Ito 


HARMONIO MAPPINGS OF RIEMANNIAN MANIFOLDS, 157 


where as usual F° stands for the right member of (2). Now fix c and tem- 
porarily put 


uP) = [BOT (Qt) le 


The dW°(P,t,)/dt are bounded as k—> œ, by Theorems 9B and 90, and so 
the u, and their first derivatives are bounded. Hence the u, form an equi-" 
continuous family, and we can suppose that the sequence £,,,,‘ - - is chosen 
so that the u+ converge uniformly, say to u. Now let G, denote the »-th 
iterate of the Green’s function G. We have 


J G(P,Q)u(Q)e1 im f G,(P, Q)ue(Q) +t 
M 


lim f nr FE at 


IEv+1>n/2, then @,. is bounded. But the dW°(P,t,)/dt converge in 
the mean to zero as k—> œ, by Corollary 60. Thus 


f G(P, Q)u(Q)21—0, 
M 


and so u==0 because of the positive-definite character of G. Therefore, 
passing to the limit in the equation above, we get for the limit mapping f 
the formula 


Wo) = f We(Qe1—f' G(P,Q)-Fe(Q) ha, 
where 
F(Q) — lim F° (Q, ty) rue (W) WEW pg. 


From this it follows (as in $10B) that W° (P) has Hölder-continuous first 
derivatives, and therefore f° is Hélder-continuous. Consequently the W°(P) 
satisfy (1). 


COROLLARY. Let M’ have non-positive Riemannian curvature and let 
f: M—> W be a continuously differentiable mapping. Let f; be the solution 
of (2) which reduces to f at i=0. If fi is bounded as to, then f is 
homotopic to a harmonic mapping F for which E(P) SE(f). In particular, 
if IM’ ts compact or satisfies the conditions of Theorem 10D, then every 
continuous mapping M —> M’ is homotopic to a harmonic mapping. 
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COROLLARY. If M’ is compact and has non-positive Riemannian curvature, 
then every homotopy class of mappings M -> M’ contains a harmonic mapping 
whose energy is an absolute minimum. 


..* For in any homotopy class we can choose a minimizing sequence of 
harmonic mappings fı fa, etc., by the preceding corollary. From Theorems 
"8B and 8D it follows that we can select a subsequence (same notation) which 
converges uniformly along with first derivatives to a continuously differen- 
tiable mapping f. Then E(f) lim E(f), and f is harmonic by Corollary 
10B. 


(B) Treorem. Let M have non-negative Ricci curvature and let W’ 
have non-positive Riemannian curvature. Suppose that M’ ts compact or 
that it satisfies the conditions of Theorem 10D. Then any continuous map 
f: M> WM’ ts homotopic to a totally geodesic map. Furthermore, 


1) if there is at least one point of M at which its Ricci curvature is 
positive, then every continuous map from M to M’ is null-homotoptc; 


2) tf the Riemannian curvature of M is everywhere negative, then every 
continuous map from M to M’ is either null-homotopic or is homotopic to a 
map of M onto a closed geodestc of M’. 


This is a combination of Theorem 3C and Corollary 11A. 


COROLLARY. Let M be a compact smooth manifold admitting a Riemann 
structure g with non-positive Riemannian curvature. Then M does not admit 
any Riemannian structure g with non-negative Ricci curvature unless that 
curvature vanishes everywhere. 


Proof. It suffices (by passing to the two leaved orientable cover if 
necessary) to consider the case that M is orientable. If there were such a 
metric g, then the identity map (M,g)—> (M,g’) would be homotopic to a 
totally geodesic map. That map has degree one, and therefore M cannot 
have any point of positive Ricci curvature relative to g. 


Remark. A special case of Theorem 11B (Part 1) can be obtained 
without the use of harmonic theory. Namely, assume ` ` 


1) that M has positive Ricci curvature everywhere; then by a theorem 
of S. Myers [20], the fundamental group m, (M,m) is finite; 
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2) that M’ is any complete Riemannian manifold with non-positive 
Riemannian curvature. Then the homotopy groups m(M’, m’) =0 for i1, 
and m, (M’,m’) has no elements of finite order. 


It is well known that the homotopy classes of maps of any arcwise con- 
nected space M into M’ are in natural 1-1 correspondence with the conjugacy 
classes of homomorphisms m, (M, m) > m (M, m’). But clearly in the situa- 
tion at hand every such homomorphism is trivial, whence every continuous 
map M— M’ is null homotopic. 


COLUMBIA UNIVERSITY, 
Tue JoHns HOPKINS UNIVERSITY, 
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ANALYTIC DISKS IN MAXIMAL IDEAL SPACES.* 


By JoBN WERMER.! 


Let X be a compact Hausdorff space. Denote by C(X), resp. Ce(X), , 
the algebra of all continuous complex-valued, resp. real-valued, functions 
on X. A function algebra on X is then a closed subalgebra of C(X) which 
contains the constants and separates the points of X. We put | f || = max] f |, 
if f is in C(X). ü 

Let A be a function algebra on X. Denote by M the maximal ideal space 
of A, taken in the Gelfand topology and hence a compact Hausdorff space. 
We may regard X as a closed subset of M and the functions in A as defined 
and continuous on all of M. 


Definition. Fix m in M. We say m is the center of an analytic disk if 
there exists a one-one continuous map ¢ of some open disk |z| <r, r>0, 
into M such that ¢(0) =m and such that for each f in A, f() is analytic 
in [z| <r. 


Definition. For m, m’ in M, put | m — m | —sup|f(m)—f(m’)|,, 
taken over all f in A with |f || =1. The relation || m — m’ | < 2 is an equiv- 
alence relation on M (Gleason, [2]). An equivalence class is called a part 
of M. 

Definition. ReA== {Ref | fin A}. 47=—{f in A |f is in A} 

In [1] we showed the following: Assume 
(1) Re A is dense (in the uniform norm) in Cp(X). 


Then if m is in M and is not a one-point part (i.e. there is some m’ in M, 
m Am, || m’—m || <2), m is the center of an analytic disk. 

In [8] Hoffman deduced the same conclusion from the weaker hypothesis: 
(2) flog |f| | f in A} is uniformly dense in Cr(X). 


Now, roughly speaking, (1) or (2) are axioms for analytic function 
theory in a simply connected domain. More precisely, let Q be a region on 
a Riemann surface whose boundary #0 consists of finitely many analytic 
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simple closed curves, with Q U 80 compact. Let A(Q) be the function algebra 
on #0 consisting of all functions in C(ôQ) which extend continuously to 
QU 80 to be analytic on Q. Then A(Q) satisfies (1) or (2) if and only if 
Q is simply connected. On the other hand, for any Q we have: 

Lemma 1. There exists a finite set of functions in A (Q), Zu, + +, Zw 
„such that the (real) vector space spanned by Re A and the functions log | Z; |, 
ml, -n ts dense in Cp(6Q). 

Proof. Let yı,‘ - ‘;ys be a homology basis of closed paths in Q. Define 
functionals I4 on Cp (dQ) as follows: if u is in Cr(dQ), let U be the harmonic. 
function in Q having u as boundary values, and V the (in general multiple- 
valued) harmonic conjugate of U. Put 


a is av 
t 


Choose wù in Oz(X) such that u is twice continuously differentiable on 00 
and (u) == 1, Li(u;) = 0, 1345. Let Us, V; be the corresponding harmonic 
functions and set Z,=exp(U,-+iV,). Then Z; will have 0 periods over 
every y hence be single-valued on Q. Also V; is locally continuous on 60 
and so Zj belongs to A(Q)-*. On 40, log|Z,| =u. If u is any smooth 


‘function in Cp(6Q), put a= L;(u) and consider u '=u—5 alog | Z; |. 

Then L,(u’) =0 for all j and so w is in Re A (Q). Since kingoth functions 

are dense in Cp(6Q), we get the assertion. 

_ We are thus led to make the following requirement on a function algebra 

A on a space X: 

(8) There exist Z, in At, 1SiSs, such that the subspace of Ce(X) 
spanned by Re A and log | Zi |, 1=1,-- -,8, is dense in (p(X). 


Definition. Fixain M. An Arens-Singer measure for a is a probability 
measure u, on X satisfying 
log | #(a)|— flog |f | dys, all f in An 
The existence of such a measure for every a in M was shown in [4]. 


Under (3), each pu, is evidently unique. 
We now fix some b in M. Assume: 
(4) If dP is any real measure on X with fu-dP—0 for all u in ReA, 
then dP == G- dp for some G in L?(p,). 


* Since, for f € A, Ref = log | ef | and ef ¢ A, it follows that also Soda = g(a), 
all ge A. 
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THEOREM 1. Assume A satisfies (3) and (4).t Let a be any point of 
M lying in the part of b, with a>£b. Then a is the center of an analytic disk. 


Note. Without loss of generality we may assume, for each i, 113s, 
that log | Z, | does not lie in the closed subspace of Cr(X) spanned by ReA 
and the log | Z; | with ji. 

Then for each i there is a real measure dP, on X with flog |Z; |-dPi==1, | 
flog | Z;|dPs—0, j&i, and fudP,—0, u in ReA. Because of (4) there 
is some G, in L? (p) with dP, = Gy: dpo. 


Definition. If m is any point of M and um its Arens-Singer measure and 
if F is any element of L* (um), F (m) = fF > dym. 


Note. Let x and y lie in the same part of M. In [2] Gleason obtained 
several consequences for z and y. In the following remarks and in the proof 
of the following Lemma we make arguments closely related to Gleason’s. 

Put for OSr<1, K(r)=sup|F(y)| taken over all F in A with 
|F(z)|Sr, |F| S1. Suppose K(r)—1. Then 3 F, in A with | F, | =1, 
|Fre)|sr, |Fa(y)|—>1. Choose conformal automorphisms ¢, of the unit 
disk such that | ¢a(Fn(t)) —¢n(Fa(y))|—>2. Since ¢n(Fn) is in A and 
| ¢n(#,) || S1, this contradicts |e—y|| <2. Hence K(r) <1, al r<1. 
Clearly also K increases with r. 


Lemma 2. Let z lie in the same part as b. Then u, is absolutely con- 
tinuous with respect to pp. 


Proof. Suppose us is not absolutely continuous with respect to m. Then 
there exists a set Q with »(Q) =0, p(Q) >0. Hence for some closed Gs 
set HCY, m(E) =0, (HE) > 0. 

Let U be the characteristic function of Æ. Choose a sequence qa in 
Cr(X), non-increasing and tending pointwise to U. By (3), we can find 
Un in ReA and scalars A‘, such that if Un = un + SAt, log | Z|, 

i 


2 Un S qna +1/n. 


Thus U,— U pointwise and boundedly. 

Now At, = [Ur dP > fU aP = 0, since m(E)=0. Hence „>U 
boundedly pointwise. We may assume u, = 0. We have us = Re fm fn in A. 
Put F,=exp(—fn). Then F, is in A, |F,|=1, 


| Fa (2) | — exp (—un (2) ) > exp(— U (2) ) = exp (— pa (E) ) =ro < 1. 


ł Added in proof: Mr. B. O'Neill of Brown University has shown that hypothesis 
(4) may be dropped in Theorem 1. 
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Hence |Fr(z)|£r <1, n>. Hence |F,(b)|<SK(n)<1 n>n. 

Hence exp(—p,(#)) <1. This is a contradiction. So we are done. 
Lemma 3. Leta lie in the part of b. Then dpa = K` dur, K in L? (m). 


Proof. By Lemma 2 and the Radon-Nikodym theorem, we can find K 
in L!(n,), with dug==Kdp,, K 20. Suppose K is not in L’. Then there 
` exists a sequence u, of functions in Cg(X) such that (i) un 0, (ii) fun?‘ dp» 
> 0, and (iii) fKu,:du,—>1. Because of (3), it is no loss of generality to 
assume 1, —= Re fa + Zum log|Z,|, with f,¢€.A, A” scalars. Then X, 


= fus: Gdp 0, each 1, and Sun du, 0 and Stn: dpo = funk dpy— 1. 
Put Fn = exp(—f,). Then F, isin A and 


| Fa | = max exp(— Re fa) S |] exp (— un) || (1 + 0(1)) 1+ 0(1). 
| sta) |= exp(— ula) + EA log |Za(a) |) > 0" 
and 
|F, (b) | = exp (— un (b) + A log | 0) >1. 
This contradicts that a and b are in the same part. Thus K is in L’. 
| Definition. H? is the closure of A in L? (py). 
H” is the intersection of H? and L* (p). 


Lemma 4. H°” is closed under multiplication, and is Banach algebra 
in the L*-norm. If a lies in the part of b, the map f—> f(a) ts a homo- 
morphism of H® into the complex field. 

T Given F, Gin H”. Fixe>0. Choose f in A with | F—f |z 


<Ip , then choose g in A with 16 -sl»<r 


Then 
| #G— fg |= || (F—f) G+ (@—g)f | 
S[S|F—f |’ delè |] G lo + [S| @—g |? din]! | flo < 2e. 


Hence F- G lies in the L?-closure of A, and so is in H”. Also H” is clearly 
closed in the norm of L”, and so is a Banach algebra in that norm. The 
last assertion easily follows from the preceding. 


Definition. B= {|8| |Z, > -| Za N] BEH? A, t, Ay real}. The 
elements of Z are thus non-negative functions defined a.e. — dpp on X, and 





MAXIMAL IDEAL SPAOES. 165 


also defined at each point in M which lies in the same part as db. From now 
on a denotes a point satisfying the hypothesis of Theorem 1. 


Definition. Ža== {F €E | F(a) =0, fF? dy, Si}. 
Lemma 5. There existe W in E, macimizing F(b). 


Proof. Puty=supF(b), taken over all F in Za. When A is the s-tuple. 
of numbers (àn Àn * *,As), we shall write | Z |> for |Z, J=: - -|Z, |. 

Fix F=|®|-|Z [in By. Write A; = [a] +9, where [ù] is the integer 
part of q and 0&8; <1. Then 


F = | &, |: |Z], ð =p. ZDA.. -ZAJ € H®, 6 = (b + ,9,). 


Without loss of generality, we may thus write each F in 2, in the form 
F—|®|-|Z|\, © in H? and each % in [0,1). 

Since each Z; is in A“, there exists ô> 0 with | Z |>= 68 on X for all à 
with 0&4 <1. Hence there is a constant K with f| 2 |? dus < E if 
F=j|e| |Z|) is in Za Thus |(b)| =]|fdm| < VE. Also |Z|>(b) 
SK. Hence F(b) = K”, all F in Ba, whence y < œ. 

Choose F, in Ze, Fu(b)>y. We may assume F,—=|-4,| | Z|” 
where A) —> © in R®. Also, since f | ©, |? da» < K we may assume &,— ®o 
weakly in L*(m). Since H? is a closed subspace of L? (pp), hence weakly 
closed, ®, is in H?. Define W=|4,||Z|*. Then W is in Z. Also 


®, (4) = sag "din m apy = (a). 


Since each F, is in By, ,(a@) = 0, each n, and so $, (a) = 0, whence W(a) = 0. 
Also f|®, |? |Z |?" dua S1, all n. Hence f|&,|?| Z|?’ dm £1401). 
It follows that {| | Zaun &1. Thus W is in Ha. Finally, W (b) 
—|8,(5)||Z(6)|%. Hence W (b) — lim Fa (b) =y. 


Lemma 6. W= 1 a.e. — dm on X. 


Proof. Choose U continuous on X with [Udw—=0. By (3), we can 
find un in ReA and A” in Re such that Un == un + log(|Z |”) tends to U 
uniformly, and we may assume fU,-dy,=0, all n. 

With us = Re fn, fa in A, put Fa == | exp (fa)| |Z X”. Then Fa is in E. 
Also Fp = exp Un, and Fpa(b) = exp( fUn dum) =1. Put =W-F,. Then 
G, is in B. Clearly Ga (a) =0 and G,(b) = W (b). l 

By the maximum property of W in Ha, it follows that fG: dus =È 1 and 
so f W°:exp(2Un)dm Z1. Let no. We get f W°- exp(2U)dm Z1. 
Replace U by tU, t a real constant. Thus A(t) = f W=- exp(2tU) dp, 21 
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= A (0), all real t. Hence (d/dt) (A) —0 att—0, and so fW?-2U dm= 0. 
Thus the measure W° du, annihilates U whenever du, does. Hence W? is 
constant a.e., and so 1 a.e. 


COROLLARY. There exist finite positive d, D with d< |®,| < D a.e. — dpr. 

Definition. With A° as in Lemma 5, set du’ = | Z |™ dup. 

Lumma Y. There exist N functions B,,: >, Ry in D?(p), with N S8, 
such that if f is in H” and f(a) — 0, then f is divisible by &, in the ring H” 
if and only if ff- Brde =0, imi, N. 


Proof. Note that L?(p’) and E? (pp) are identical as function spaces and 
have equivalent norms. Put 


6 — {F -®, | F is in H*}. 
If F is in H?, there exist f, in A, fa—> F in L?. Then 
Oh |? dm — f | ol? | F—fa |? da0 


whence F-&, ig in H?. Thus @ is contained in H*. Also, since |®,|>d, 
& is a closed subspace of H*, and also a closed subspace of L?(p’). Let 
H= {f in H?| f(a) =0}. Then @ is contained in H,?. 

Write H.9.& for the orthocomplement of 6 in H,? in the inner product of 
L?(w). Fix kin H,76@. Since f®, isin @, all f in A, we have 


(5) SfGok du’ —0, all f in A. 


Fix f in A, f(b) —=0. Then fk is in H? and fk(a)—0, fk(b)—=0. Put 
Wr=|®.+t-f-k|-|Z|)’ Then W, is in Æ for every complex 2. Also 
W) =W (b), W,(a)—0. Hence 


SW du, = 1, or Slott fk |? dp’ = S| Bo |? dy’, 
all scalars t Hence 1 fk in L?(p’), i.e. 


(6) S Bofk du! — fF (Gk) dy’ —0, fe A, f(b) =0. 


Because of (5) and (6), ®ok dw annihilates Re A. 

Consider now the orthocomplement (Re A) of Re A in L? (u). (ReA)t 
has dimension s. Since ®,k du’ annihilates Re A, Pok- |Z | is in (Re A)1. 
This holds for each k in H,70@. Hence H08 has dimension N Ss. 

Let now f be an element of H® with f(a) =0. Then f is divisible by 
ð, in H” if and only if f is in @, if and only if f is orthogonal to H,&, 
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and so at last if and only if ff Rdw —0, i=l, <, N, where {Ri} is an 
orthonormal basis for H08. 


COROLLARY. Let H,” denote {f in H* | f(a) <0}. Then there exist 
&° + éy in Ha”, and we may take the & to lie in A, such that every f in 
H,” can be written in the form: 


n . 
(7) f=F + E 44 F in H”, h scalars. 
ia 


In particular, ®o, &,° + -én generate Ha” as ideal in H”. 


Proof. R,'+-+,Eyw is an orthonormal basis for H.06. Hence 
fEiB;dp = 8). Since we can approximate each R; in L? by functions f in 
A with f(a) —0, we can construct- new functions & in A, &(a) =0, with 


N 
SER =s. Fix fin Ho". Pub yo ffaw. Then FF Lkr 

satisfies [f* B: dp’ —0, all 4, and so f* is divisible by ®. Hence we get (7). 
We now need a result of Gleason (unpublished). 


Gumason’s Lemma. Let A be any commutative semi-simple Banach 
algebra with identity, DM its maximal ideal space, m a point of M. Assume m 
is generated, as ideal of U, by g1,°- +, gn. Then there is a neighborhood N 
of m in M and a polyeylinder P,:|%| <r, i=1,: - -n in Cr, r>0, such 
that the map: x-> (gi(@),° ` ',9n(2)) maps N homeomorphically on a sub- 
set V of P,, and 


(8) V is an analytic subvartety of P,, containing 0, and 


(9) For each h in U there is a function pa analytic in P, with 
h=¢a(Gi," > sgn) m N. 


We now apply this Lemma to the case X =H”, Mt=-S(H”) is the 
maximal ideal space of H=. Take for m the homomorphism @: f— f(a). 
By (7), Ha” is generated by ©, &,---,éy. Let P, and V denote the asso- 
ciated polycylinder of CN*: and analytic subvariety of P, of the preceding 
Lemma, and let Jt be the associated neighborhood of @ in 8(H”). 


Lemma 8. There ts some ro O <T Sr, such that Pa N V meets each 
hyperplane zı = à at most finitely often. i 


Proof. Consider the Banach space H” @ CN" which is the direct sum 
of H” and ON". Let T be the linear map‘ of H” & CN# into H” which 
sends 
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N 
(F, ts, ° z nint) > BB + Bake t 


By (7), T maps onto H”. Also T is one-one. Hence every linear transforma- 
tion T” of H” @ CN into H” with || 7’—T || <e, for some «> 0, maps 
onto H”. For each ” <r, put N- equal to the subneighborhood of N which 
‚the map x: z> (®)(z),&(z),: -© -,é,(@)) maps on VO Py. For z in Ny 
define a linear map Ts by 


Ta(F, t, x ‚im t) =F. (o — &(z)) + Eu 62) +i 


Then fix r, such that for z in Ne || Te—T || <« and so Ts maps onto H*. 
If now z is in N,, and f is in H”, 


[=F (Be) HERE) +t 


N 
whence f= J k (é&— é&(r)) -+t modulo the ideal generated by 8. — &,(z). 
t=1 


Hence for each j the functions 1, &- - -,&‘** are linearly dependent modulo 
that ideal, and so for some polynomial P;: 


(10) P;(&) = F; (&— ©,(2)) for some F; in H”. 


Hence if two points z and y in N,, have images x(x) and x(y) in V N Pn in 
the hyperplane: z, = À, i.e. if ®, (x) =, (y) =A, then 


Ps) = Fs ly) (By) — Bo(z)) = 0 


and so (y) is one of the finitely many roots of the equation P,(z) 0. 
It follows that only finitely many points of VM Pn lie in the hyperplane: 
2 =À. 


CoroLLaRy. If zis a regular point of V sufficiently close to 0, then the 
dimension of V at z is 1 or 0. 


Lemma 9. In a suitable neighborhood U of 0 in ON* we have 
| UNnNY=D,U DU: -UDe 


where for each i there exists a one-one analytic map ya of |A| <1 on D, 
i= 1,: - k, and (0) =0. 


Proof. Let (V) denote the germ of the variety V at 0, and let (F;), 
i= 1,: : -k be the irreducible branches of (V), so that $ 


t Such a map is used in the proof of Gleason’s Lemma. 
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Because of the preceding Corollary each (V,) has dimension 1 or 0. We 
claim each (V,) has dimension 1. 

For else (V) reduces to the single point 0, and thus 0 is an isolated 
‘point on V. Since x is a homeomorphism from S(H”) into ON* on some | 
neighborhood of ä, then @ is isolated in S(H*). It follows by a well-known: 
result of Silov that there exists e in H” with e(a) 0, e(m) —1 on the 
rest of S(H°). Hence ||e||==1 and e(b) =1. Now for f in H°” 


f(a) = ff: K dps, f(b) = ff du», K in D (m), K 20. 


It follows that a and b belong to the same part of S(H*). But this contra- 
dicts that e(a) = 0, e(b) =1, || e || = 1, by the discussion preceding Lemma 2. 
(The argument here was suggested by Andrew Browder). 

Thus each (V,) is a 1-dimensional irreducible germ of variety at 0. 
The assertion of the Lemma follows from this. 


Note. We shall consider V as identified with x*(V) in S(H*). The 
elements of H can then be regarded as functions on'V, and @ as the origin 
in ON, 


Lemma 10. Fis i, 1Sı=k Put D= D; of the previous lemma. 
Then there exists f in A with f (0) = 0, but f not identically 0 on D. 


Proof. Suppose the contrary. Then f in A and f(a) = 0 implies f==0 
on D. 

Since ®, is in H?, and ®, (a) = 0, we can choose {fs} in A, fa(a) = 0, 
so that fs >) in L? == L? (p). Recall the functions &,---+,éy of the 


N 

Corollary to Lemma 7. By (7), fa =Fn: o + X 4k, where FRE H”, the 
4=1 

&™ are scalars. Let the Ry be as in Lemma 7. Then 


ffr Brdu = i> fdo By dul — 0. 


Hence Fp'Bo—> D, in L? and so F„—>1 in L?, since| ®,| is bounded away 
from 0. It follows that F„(a)—1. Hence for large n,F,(a) 40. As a 
function on D, F, is continuous and +0 at 0, hence +40 in some neighbor- 
hood of 0. Also F,-%, is in A, since fa is in A and the & are in A, and 
Fa: ® (a) 0. Hence by supposition, F,-4,==0 on D. It follows that ©, 
vanishes in some neighborhood of 0 on D. Hence D meets the hyperplane: 
2,==0 infinitely often, and this contradicts Lemma 8. Hence our assertion - 
is correct. 
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Proof of Theorem 1. As before, fix i and put D = D, and put y = y; 
where y; is the one-analytic map of |A| < 1 on D existing by Lemma 9. 

Let A, be the collection of functions f(y) with f in A. Then A, is an 
algebra of analytic functions on |A| <1. By Lemma 10, there exists fe in | 
A with f,(0) == 0 and fo340 on D. Then fy(y) belongs to A, and without 
loss of generality we may assume f)(W)—=A*(1+cA+:-:). Hence 

*fo(w) =Æ, where é is a function analytic and one-one in some neighborhood 
of 0. A suitable neighborhood of 0 is then mapped by é conformally and 
one-one on a disk |é] <r. 

For each f in A, define F in |é| <r by f(¥(z)) = F(é(z)). Then F 
is analytic in | é| <r. Let A, denote the algebra of all these functions F. 
We do not know whether or not A, separates points on |é| <r. We know 
that & isin A,. By an elementary argument one may now show the following: 
there exists 8 == exp 2nt/l and To, O < fo <r, such that in the disk |é| < ro 
two points z and y are identified by the algebra A, if and only if y 8”: z 
for some n. 

It follows that for al F in A, F(w/') is an analytic single valued 
function of w in the disk | w| <r) Fix w in |w|<r. If f is in A, 
f(y) =F (£) for some Fin Ay. We define a map s(w) of A into the scalars 
by: f>F(w'). Clearly ¢(w) is a homomorphism and so a point of M. 
Fix w, and w, and suppose d(w.) == p(w). It follows that F(w,*/') 
== F (w,!), all F in A,, whence w,1/! == B+ w,/! for some n, and 80 w,—= Wa 
Thus ¢ is a one-one map of | w| < r,t into M, with ¢(0) =a. Further, for 
fin A, f(¢(w)) —F(w?) is an analytic function of w. It follows that ¢ 
is continuous as a map from the disk to M. Thus a is the center of an analytic 
disk. 
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SPHERICAL FUNCTIONS OVER %-ADIC FIELDS, II.* 


By F. I. MAUTNER. 


1. Introduction and preliminaries, This is a continuation of Part I- 
(see Mautner [1]) and the same notation and terminology will be used as 
in Part I. We shall study certain classes of functions on the projective group 
G= PGL (2,0) over a P-adic field Q, i.e. a field which is complete under a 
given discrete real valued valuation | | and which has a finite residue class 
field D/P with g =NP elements (see §1 of Part I). 

As in Part I let K be the subgroup of G consisting of P-adie integral 
linear fractional transformations. We know that K is a maximal compact 
subgroup of @ which is also open in @ (see §§1 and 2 of Part I). Now let u 
be an irreducible continuous unitary representation of K acting in a finite 
dimensional vector space b over the complex numbers. 


Definition 1.1. Let S, be the class of all functions f(g) on G whose 

values are linear transformations of b and which satisfy 
(1.1) f(kgk’) =u(k)f(g)u(k’) for all gE G,k and KEK. 
By S,y° we denote the class of functions in Su which are of compact support 
on G. Note that f(g) € Sy implies that f(g) is continuous, since G/K is 
discrete and u(k) continuous on K. One sees that §,° is an algebra with 
convolution on @ as product. 

We shall study the algebra 9,° for certain irreducible representations u 
of K (the principal series mod P”, see §3 below). For these u == ux which 
are naturally parameterized by primitive congruence characters x, we shall 
describe in detail a subalgebra ©,° of S,° on which the principal series 
M(g,a) of representations of G (introduced in Part I) will turn out to be 
one-one. It will be shown that the Fourier transform on G maps ©,° iso- 
morphically onto the algebra of all Fourier polynomials and the Plancherel 
formula will be obtained for the corresponding subspace ©,? of L?(G@) (see 
886 and 7). For this purpose the principal series M(g,«) has to be studied 
in some detail in §3 below and some matrix coefficients Mp(g,a) of M(g,«) 
have to be computed (in §4). This allows one to compute the Fourier trans- 


Received May 27, 1963. 
* Most of this was written several years ago. Some details have hecently been added 
under NSF Grant G-230011. 


171 


172 F. I. MAUTNER. 


forms on @ with respect to the principal series M(g,a) quite explicitly in 
terms of ordinary Fourier series for functions in S? (§5) which leads to the 
Plancherel formula for ©,?. However the full Plancherel formula for L(G) 
remains unknown.!* In fact it will be seen in §8 that the principal series 
M(g,«) is siot one-one on functions of compact support, not even on- 94° 
(or 8,°). The question thus arises what the other irreducible unitary repre- 
*sentations of Gare. ; , 

Some of them will be obtained in §9 where it will be shown that there 
exist discrete series of irreducible unitary representations of G. Their matrix- 
coefficients (in suitable orthonormal bases) will be seen to be functions of 
compact support on G! 

These results have various arithmetic consequences. If one lets the 
algebra 8,° act on suitable function spaces defined on spaces of idele-classes 
of quaternion algebras one obtains natural generalizations of Hecke’s operators. 
In particular if one restricts oneself to ©,° for u= ux one can locate the 
zeros of the characteristic polynomials Z(s,x) of these generalized Hecke 
operators. Indeed one obtains in this manner for each primitive congruence 
character x a polynomial Z(s,x) in q? which satisfies Z(1—s8, x) =Z(s, x) 
and has an analogue of an Euler product. For y==1 (and suitable quaternion 
algebras) Z(s,1) is a congruence-zeta function of Artin, Hasse and Weil for 
eertain curves modg. However if x is a non-real character no such interpre- 
tation is known, but the results of the present paper (especially §7) imply 
that Z(s,x) has all its zeros on Rs—4. For real x I have not been able to 
decide whether Z(s,x) may also have real zeros. This seems to be as difficult 
as Ramanujan’s conjecture on the order of magnitude of cusp forms and is 
closely related to it. The coefficients of Z(s,x) can be determined explicitly 
in terms of class numbers of certain quadratic fields or equivalently in terms 
of Siegel’s representation functions of certain ternary quadratic forms, All 
this will be discussed in detail. elsewhere. 


2. The algebras S,° and Sẹ. Let us introduce an arbitrary ortho- 
normal basis in the r-dimensional representation space b of the given unitary 
representation u of K and denote by u„(k) the matrix-coefficients of u(k) 
with respect to this basis. Then the function? 


(2.1) e(k) = ruu (k) 


1a Added in proof: In the meantime several articles by I. M. Gelfand and M. I. Graev 
have appeared on this subject. See Doklady Akademii Nauk SSSR 146, pp. 757-760, 147, 
pp. 529-532, 161, pp. 262-264 and Uspehi Matematiöeskih Nauk XVIII, pp. 29-99. 
? Assuming that the Haar measure is normalized so that the total measure of K 
_ equals one. 
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is for fixed i==1,2,; < ‘,r, a self-adjoint minimal idempotent on K, 


(2.2) e(k) =ë (k+) = f e( kt) 0(f) dt, 
as follows at once from the well known orthogonality relations on the compact 
group K. 


Definition 2.1. Let S denote the set of all (equivalence classes of)” 
complex valued Haar-Lebesgue measurable function f(g) on G which satisfy 


Sf(g) |? dg <% and 

(2.3) Fg) = f, e gde |, tor) eik)dk. 

One verifies at once that 3, is a closed subalgebra of the normed algebra 
L(G). 

By 9 we denote the set of all f(g) € S,' which are of compact support 
on G. One notes that S. is a subalgebra of the group-algebra of all con- 
tinuous functions of compact support on G. 

Let f(g) € Sy. For each g€ G the value of f(g) is by definition a linear 


transformation of b. With respect to the above orthonormal basis in b let 
fn(g) denote the matrix-coefficients of this linear transformation. 


Lemma 2.1. The mapping 
(2. 4) f(g) > rfu(g) 


ts for each fixed 1-1,2,---,r a *-isomorphism of S,° onto 8,°. 


Proof. Let us note first that f(g) € 8,° implies fu(g) € 8%. Indeed 
using the orthogonality relations on K we have 


Ja ede f° ful) (le) rau) dk 


= f, Felg) ünlk)run(k)de—Fu(g) 
by the definition of e(k) and S,. Similarly 
f efu lig) dk fulg). 
Clearly f(g) of compact support implies that fa(g) is of compact support, 


so that fu(g) € 5. The mapping (2.4) is clearly linear. To prove that it is 
one-one let us note that f(g) € S, implies 
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(2.5) fulg)— fy S, fag ru Eae at 


which is verified at once, using the orthogonality relations on K and (1.1) 
above. Hence fy(g)==0 for all ge G implies fy(g)—=0 for all gEG 
and 1,j—1,---,r. Thus (2.4) is one-one. We now prove that (2.4) 
. preserves convolution. Let a(g) € 8,° and b(g) € S,° and denote by ay(g) 
“and by(g) their matrix-coefficients. Then the i-th diagonal matrix-coefficient 
of fa(gh*)b(h)dh equals f Sau(gh*)bu(h)dh. By (2.5) this equals 

I 


ny J. Í, Í Oy (gh kt) un(k)un(k)du(E*h) dk dt dh. 
Let u’y(g) be the extension of uy(g) to G defined by putting 


P u if gEK 
wal) — | u. if ne 


so that w’y(g) is a continuous function on @ of compact support. Then the 
integrals over K can be replaced by integrals over G in the last expression. 
Hence, if + denotes convolution on @ we have 


r r 

, 
2 mu * du — E auty? Wu by = Tau * UG * bu 
=1 1=1 


by the orthogonality relations on K. But rwu*bu==by since b(g) € 4°, 
whence by(g) € S,° as noted above. This proves 


(2.6) 2 Ga + bu == ras * bu. 


It remains to prove that the mapping (2.4) is onto 8,°. Let f(g) € 8e. 
Define fy(g) by fy =r ur f arwa. For each ge @ let f(g) be the linear 
transformation of b whose matrix is fy(g) with respect to the basis introduced 
in b at the beginning of this section. One verifies at once that f(g) € 8,° 
and that the image of f(g) under (2.4) equals f(g). 

Let us now consider the double coset of Ky’K for fixed v> 0. The group 
KXE acts transitively on Ky’K by transforming ge Ky’K into kgf? with 
&,f€ K. Let us find the subgroup which leaves the point y” fixed: kpt = y’, 
or in terms of matrices 


a 5 a r ) Gi 3) 
ka Ka 0 1/7 W 1 fes faa 


kur” k 1) Ge vt ‘) 
2,7 1 i 1 
( ) eae kaz fa Taz : 
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Now all ky and fy are elements of ©, so that we must have kı: € P” and 
fu € P. Let &, be the subgroup of R = GL(2,0) with kı: € Pr and &,* the 
group of transposed matrices. The map 


(2.8) (ky) > es 1) (ku) iG i) 


is clearly an isomorphism of &, onto §,*. Let us apply the natural homo-. 
morphism of © = @L(2,0) onto G== PGL(2,Q) to this situation. Letting 
K, and K,* be the images of ®, and &,', we obtain from (2.8) a well defined 
isomorphism of K, onto K,* which we denoted by (v). And 


(2.9) kyt = y” if and only if ke K, and t= k”. 


Now let u be a representation of K in an r-dimensional vector space b. 
We wish to find all r X r matrices X satisfying 


u(k)Xu(f) =X whenever ke K, and È =k, 
i.e. 


(2.10) u(k)X —=Xu(k) for all ke K, 


Let us write u,(k) =u(k() for kE K, then u, is a representation of K, and 
(2.10) can be rewritten 


(2.11) u(k)X —Xu,(k) for all k€ Ky. 


Thus we are looking for all matrices X which “intertwine” the two repre- 
sentations u, u, of the compact group K, and have proved 


Lemma 2.2. The elements f of Su which vanish outside the double coset 
Ky’E are in natural one-one correspondence with the matrices X which satisfy 
(2.11). 


Let us make 


Definition 2.2. We denote by Su(v) the set of all f€ Su which vanish 
outside the double coset Ky’K, similarly by Se(v) the space of those fES, 
which vanish outside Ky’K. 


Then we can restate Lemma 2.2 more precisely: Let X denote the 
restriction of f to y”. The map f>X maps S,(v) one-one linearly onto the 
space of all X satisfying (2.11). 


8. The principal series of representations of G. As in Part I, let 
M(g,«) denote again the principal series of representations of G defined as 
induced representations 
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(3.1) ne a 

where a is a character of A extended to a one-dimensional representation of 
AB by putting a(ab) =a(a). (Cf. §3 of Part I, also Mackey [1] for the 
definition and basic properties of induced representations.) The represen- 
tation space of M(g,«) is a space of functions ¥(g) on G satisfying ¥ (abg) 
-<-a(a)¥(g). We note that &(g) is determined by its restriction to K, 
because @—= ABK. 

Now let us consider the restriction of M(g,«) to K. This can be 

described by 


[M(k,a)W](t) = X (fk) and G(abk) = a(a)¥(k) 


for all k,f¢€ K, a€ AN K, BE BOK, so that a(a) =a (a) where a, is the | 
restriction of « to AM K. This proves 
(3.2) restriction to K of inda = ind a 

ABTG (KN AB)TtE 
where a, = restriction of «to A N K, considered as one-dimensional represen- 
tation of K N AB. 

Now let u be an irreducible continuous unitary representation of K. By 
the Frobenius reciprocity theorem u is contained in the induced representation 
(3.2) above as often as the restriction of u to K N AB, which we denote by 
u(K N AB), contains a, (K NAB). 

Now we consider the following special kind of representation u. For 
fixed m, let Æ == K) denote? the projective group POL (2, q™) over the ring 
O/P”. There exists a natural homomorphism of K onto K, namely reduction 
modulo ™. Let A and B be the images of ‘A, respectively B, under this 
homomorphism, so that A is isomorphic to the multiplicative group of inver- 
tible elements of D/P", B to the additive group of O/P". Let x be a 
character of A, which we extend to a one-dimensional representation of AB 
by putting x(25) = x(a). Now let ü be the induced representation 
(3.3) ü= ind x. 

ABIE 

Let us apply again the Frobenius reciprocity theorem to this: We see 
that if a is irreducible, then the restriction G(AB) of % to AB contains x 
exactly once: 

(3.4) multiplicity of x(AB) in (AB) =1, 


® Throughout this section K, A, B, a,: - : do not denote complex conjugates; else- 
where # denotes the complex conjugate of any complex number g. 
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provided & is an irreducible representation of Æ given by (3.3). 


If we combine the homomorphism K —> K with the representation i == dx 
of Æ defined by (3.3) we obtain a unitary representation of K which we 
denote by ux: 

(3.5) ux(k) =üx(k) where k— KM 

if k is mapped into & under the homomorphism K —> K and K™ denotes the 

subgroup of those elements k of K which are congruent to the identity modulo 
m i.e. k is given by a matrix (ky) such that 


(3. 6) ‘ ky = Sy (mod Pr). 


Now let us assume that œ, is identically one on 14%” so that we can 
identify «, with a character of A (==image of A under the homomorphism 
K—R). Let x also be a character of A. We wish to find the multiplicity 
of u — tux (as defined by (3.5) above) in the representation 
(3.7) ind @. 

(KO ABE 

By the Frobenius reciprocity theorem this multiplicity equals the multiplicity 
of a, (considered as a character of AB N K) in u(ABN K) [restriction 
of u to ABM K]. By taking the homomorphism K — £ the latter equals the 
multiplicity of æ, (considered as a character of 4B) in the restriction (AB) 
of ü to AB where ù is defined by (3.3). Now let us assume that @ == ix = indy 
is an irreducible representation of K and let us decompose its restriction to 
AB into inequivalent irreducible representations p of AB occurring with multi- 
plicity mpx: 


(3.8) dx (AB) = ZO mpx p. 
p 
Applying again the Frobenius reciprocity theorem we see that 
(3.9) ind p contains tx exactly mpx times. 
ARE 


In particular let p(ãb) == «, (ã) and we see that 


Ma,,x = multiplicity of a, (AB) in üx(AB) 
== multiplicity of üx in ind æ, = ŭa. 
Z. BYK 


(3.10) 


Hence if a, is such that te, is also irreducible, then (3.10) equals 1 or 0 
according as üx and te, are equivalent representations of K or not. 
We now have to decide when ux is irreducible. This is of course not new. 


12 
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Lexma 3.1. Lety be a non-real primitive congruence character mod %*, 
i.e. let x be a non-real character of U and m the smallest integer such that x 
is one on 1+". Then the principal series mod 8" as defined by (8.3) 
is an irreducible representation of PAL(2, O/R”) =È. 


Proof. The representation t == ŭx is defined (see (3.3) above) to be the 
induced representation indy. Hence the commuting algebra is given by the 
function f(k) defined on Æ and satisfying f(@bk) =x(ä)f(k) =f(käb). So 
we have to consider the double cosets AB k AB of AB in Ë. They are easily 


seen to be AB, AB w AB and AB} j JAZ with 1=1,- + -»m—1. Now 
T 

ab $ 0 a -+ br! J 

0 1 7 1 T! 1 

1 0) Yeo) Foe 4 ) 

rt. 1 0 1) \re rh’ +1 


give equal elements of K if and only if 

a x 

ria = ert, 1 + rib =e (miod pn 
for some eE N. Thus 1- r!eb=e, so that a’ =«(a+1)—1 (mod H”) and 
g'ri er =ert (a 41) —r! gives r'(ea—1)=0 (mod H=). We can cer- 
tainly find elements a and e of U such that r!(ea— 1) = 0 (mod P™) then define 
a’ by d'= e(a +1) —1 (mod R”) and have x(a) x(a’) since y is a primitive 
character mod P”. Hence any function f(k) satisfying f(abk) =x(ä)f(k) 


f (Kab) must vanish on AB ( 5 1) 4B. 


and 


It remains to consider ABwAB. Since dia—a in X we must have 
f (@w a)—f(%) hence x(a?)f(#) —=f(w). By hypothesis x is not real, i.e. 
x(@)*341 for some ä, hence f{ö)—0. This proves that the commuting 
~ algebra of dx consists of functions vanishing outside AB and clearly f(ab) 
== ¢ (2) for some complex number c, hence consists of the scalar multiples 
of the identity operator only. This proves Lemma 3.1. 
If we combine Lemma 3.1 with the result (proved above) that (3.10) 
equals 1 or 0 according as ux and te, are equivalent or not provided they are 
irreducible, we obtain 


THEOREM 3.1. Let a be a character of A and a, tts restriction to AN K, 
so that a, can be considered to be a character of U. Assume that a,(n) ts 
not real for some EU. Let m be the smallest integer such that a, is 
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identically one on 14+-®P”. Let x be also a primitive non-real character of 
U/(1-+ Br) and form the unitary representation u = ux as defined by (3.5). 

Then ux occurs in the restriction of the principal series M(g,«) to K ‘either 
exactly once or not at all according as üx and ta, are equivalent representations 


of È or not. Here Ë = PGL(2, 0/8"). 


One can write down quite explicitly and directly a subspace which trans- 
forms according to this u under M(k,a). Indeed the representation space 
of M(k,a) can be taken to consist of functions ¥(k) satisfying ¥ (abk) 
— g(a) (k) for ke K, ab€ ABN K, as we have seen above. Let Km be 
the subgroup of K whose elements are given by ®-adic integral matrices 
=] (mod P”) ; then we must have M(W’,a)%—¥ for all hE K™, i.e. 


(3.11) U(kk’) =Y (k) for ke K, VE Km 


so that % must be a function on K=K/K™, Now a, is by hypothesis a 
character mod P”, i.e. a(1+ 8") —1, so that ©, (a) —a(@). Thus (3.11) 
implies that we are dealing with all functions on X satisfying ¥(abk) 
—=0,(4)¥(k) and [M (7, a) Y] (k)— v (kk). This is precisely the definition 
of the induced representation ind 4%. 
A-BtE 

This proves 

Lemma 3.2. The subspace which transforms according to ua, under 
M(k,a) for ke K consists exactly of those functions % which satisfy 
M(k’,4)U—W for eC K™, Since it is equivalently given by (3.11) it has 
dimension g™ +- gm. 


We shall use the following expression for M(g,a). The factorspace 
@/AB is homeomorphic to the projective line over Q. In every coset except 
that corresponding to the point at infinity there exists an element x of @ 
which is given by a. matrix © D Consider any function ¥(g) in the 
representation space of M(g,a) and its transform W by M(g,a), i.e. 
Y=M(g,e)%, which means by definition W (g) =¥(gg) for all g and 


gEG. Let g= y then gg — gg = abr, where y, is given by a matrix C i) 


provided zg does not belong to the coset mod A: B corresponding to the point 
at infinity. We obtain W (g) —¥(rg) = ¥(abr,) —a(a)&(z,) where a is 


given by a diagonal matrix E 2) and 5 by a matrix © i): Let us 
2 


consider the matrix equation corresponding to rg == abg: 


180 F. I. MAUTNER. 
re 
g 1 Ju Jog 0 as 01 a 1 
i.e. 


(3.12) ( Ja gue ) = (ies ne 
" gir + Is Tgi + gzz Ag az 


Thus az= 2912+ goz and T4 = art (gaT + Ja), hence 
Git + Gor 
T = H 
Gi2t + Gee 
- if g is given by the matrix (gy). Moreover a,(1+bz,) gi. and a,b =g 
imply 


det (gy) ; 
3.14 u ded 912% 0. 
( ) ay ae provided 9120 + Ja: 7E 


(3. 13) 


1 
© 
P (£) =a (a) (gat + 921/912 + Jor). Now a is a character of A and A = QX, 


since the mep ( i) —>ņ is one-one, we can write Y (g) == W(z) and obtain 


; 0 
Thus when a is given by a diagonal matrix © 3 we shall have 


a(a) =a (a/a). Therefore we obtain 


(3.15)  [M(g,a)¥] (x) =al (gree + gar) *det (gy) ]¥ = = 2) : 


provided gi2t + ga2540. As g is an element of G—PGL(2,), the matrix 
(gy) can be multiplied by any ce 9X; but we note that the right side of 
(8.15) does not change if (gy) is replaced by (cgy). 


Let we G be given by ®- z 


as an operator on L°(Q, dz). Let us write 


) ‚Le wz = — x! and consider M (w, a) 


(8.16) a= 7" with n—orda, nE U and a(a) = g**a, (7) 
where s is an arbitrary complex number and æ, = restriction of a to U is a 
character of U. 


LEMMA 3.3. M(w,a) is a unitary operator of L?(Q,dzr) if and only 
tf o= Rs — ft. 


Proof. By (3.15) we have 


[Af (w, a) t] (2) = a(z) 3t (— a) 
so that * 


“As in Part I the symbol | |, denotes the ordinary absolute value of a complex 
number throughout, to distingnish it from the normalized PB-adie absolute value | |. 
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| M (w, a) © ||? = fl a(x) t (— a) | da = fl «(— 2%) (z) |a? | 2 |? de. 
Hence 
|H (w,a)¥ | = | ¥ |) for all we L*(Q, de) 

if and only if | a(x)|.2— || for all ze 0%, i.e. if and only if |«(r") |? 
== |7” |, ie ge) ang, ie. 0}. A 

From this we obtain at once 

Lemma 3.4. M(g,a) is a unitary operator of L?(Q,dz) for all ge@ 
if and only if o==Rs—= 4. 


Proof. Let us note that @ is generated by w, A and Bt. If ge Bt then 
M(g,a) is unitary for all æ. It remains to observe that M(g,«) is unitary 


for gE A if c=}. Indeed if g is given by G and s— 4+ it, with t 
real, then 

[M (g, a) X] (2) = a(a) (ar) = gra, (q) Y (az) 
so that 


| M(g,a)¥ |*= fq” |E (as) |de= fg” |E (r)]a?: |a |7 de 
= f] F(z) |." de. 


THEOREM 3.2. Let a(a) be gwen by (3.16) with Rs =}. Then 
g—>M(g,a) is an irreducible unitary representation of G with Hilbert space 
L (Q, dz). In fact the restriction to AB is already irreducible. 


Proof. By Lemma 3.8 M(g,«) is unitary. The irreducibility under AB 
is proved in the same way as in the case of the real and complex numbers. 
One observes that any bounded operator which commutes with all translations 
Ylz) > ¥(e+ 6) is in the algebra generated by such translations, i.e. after 
Fourier transform on the additive group of Q is multiplication by a bounded 
measurable function. But QX is transitive on the non-constant additive 
characters of ©, so that if C is to commute also with all ¥ (x) > a(a)Ẹ (ar), 
it must be a scalar multiple of the identity: C == cI. 

The irreducibility of the principal series (for almost all «) was proved 
in the case of the classical groups over B-adic fields by Bruhat [1]. 

Let x be a congruence character mod $3" as above, then the above implies 
that the representation üx defined by (3.3) can be written as an explicit 
multiplier representation analogous to (3.15) as follows. Let s vary over 
the projective line over O/B" and ¥(x) an arbitrary complex valued function 
of x, then for ke = Km 
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kus -+ a) ! 
kit + kaz 


holds whenever kat + kzz is a unit of O/R”. We shall now prove 


(3.17)  [8x(k)Y] (2) — xf (krz + kez)” det k]¥ ( 


Lemma 3.5. Let x be a primitive congruence character mod P” and a, 
a primitive congruence character mod Pr. If m, m then a, (AB) =a (Ã) 
does not occur in the restriction of üx to AB. 


Proof. We have to consider the restrictions of üx to AB. Let us use 
the explicit form (3.17) of üx as multiplier representation on the projective 
line over O/H”. If z is a finite point of this line then so is ar+b. Hence if 
Y vanishes outside the finite points then [dx(ab)¥](z) =x(a)F(ac+b). 
Therefore üx(b)¥ — implies that ¥(z) — constant for all finite z and for 
such % clearly üx(ab)F==x(a)W. Next we have to consider the orbits under 
AB consisting of points of infinity. Let fı(£) —0 unless ord(x) ==] then 
fı=%(w)fı vanishes outside an orbit under AB. Now dx (ab) fp == a (a) fi 
is equivalent to tx(wtabw)f;—«,(a)f, ie. 


xL(a— ba) alfil —>—) = a (a) fi(z) 


Hence filr! (1 + br) | = cx(1 + br!) for all bE O/B" and x(a) filar!) 
==4,(a)fi(7') for all units a, in particular for a == 1 -+ br! we get 
cy (1 + br?) = cy (1 + br?) a (1 + br!) 

i.e. o,(1-+ br?) =x(1-+-br') for all b which is possible only if a is a 
primitive congruence character mod P”. 

There only remains one other orbit under AB, namely the point 1/0. 
Its characteristic function Ye satisfies tx(ab)¥.=—y(a")¥,. Thus we have 
determined all & which satisfy üx(ab)¥ = ca¥ and shown that for none of 
them is Ca equal to «,(@) which proves Lemma 3. 5. 

If we combine Lemma 3.5 with equations (3.4), (3.8), (3.9) aad 
(3.10) we obtain 


THEOREM 3.3. Let m, be the smallest integer such that a(1 + Pr) —1. 
Let x be a primitive non-real congruence character mod R™, If m4m then 
ux does not occur in the restriction of M(g,a) to K. 


Let us also note 


Lemma 8.6. The representations 


g>M(gt+it,a) and g> M(g,$ +i, ay’) 
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of G are equivalent if and only tf (Y,a) = (t,a,) or (—t, a11). The repre- 
sentations ux’ and ux of K are equivalent if and only ify’ ==x or xt. 


4. Computation of the matrix coefficients M;,(g,¢). We wish to find 
a subspace of L?(Q,dr) which transforms according to the representation 
Ua, of K (see 3.5 above). By (3.11) and Lemma 3.1 above the elements ¥ 
of this subspace must satisfy M (k, a) Y = Y for all ke K™. Let j vary over 
a set of representatives for the cosets of BP” in O and define ¥,(x) by 
g3 if ce BM j 
Se Ha, een 
Note that these functions are pair-wise orthogonal and 


IMI f uued) ar | demi. 
g Bess Br 


Next let w be the linear transformation given by the matrix ( 9 z i.e. 
we—=— rc". If j is as above and a zero divisor mod $*, i.e. JER, we put 


a(s) g if ote m4 5 

0 it ote P+ yj. 
We note that when @ is such that M(w,«) is unitary then ¥,,¢ L? (Q, de) 
and || Wu; || =1; restricting ourselves to such a we have 


(4.2) Voy M (w, a), ie. Yale) = | 


(4.3) LE; Pey = by, ¢ 


for all 5, 7’ (including œj), where <,> denotes the inner product in L*(Q, dz). 
Since 7 now varies over the union of a set of representatives for the cosets 
of Br in O and the elements œj(== wj for JEW (modP”) we obtain an 
orthonormal set of q” + q”"! functions %, for each a for which M(w,a) is 
unitary. 

We show next that M (k, a) t; == Y; for ke K™, Indeed 


M (k, a) W,(a2) = a (haat + ka)? det bY, (tis). 
Let zeP"=+35 and jtoj, ie. GEO then kı tknei+N”, so that 
a(Ky2t + ka) = 1; also kıc+ ka EP” -+ j, so that if ke K™ and jz£oj 
then se PB” 35 if and only if (kus -+ kn) (kis + kz) EPI This 
proves M(k,a)¥;— %, for ke K™ and jz£w,j. It remains to consider Yaj 
We note that for je ® we have , 


184 F. I. MAUTNER. 


M (k, a) = M (k, a) M (w, a) 8; M (w, a) M (wkw, a) by M (w, a) vy 


since wiK@™y—K™, Hence M (k,a)Yaj = Ya for ke K™. Thus the 
subspace of L? (Q, dr) spanned by the functions ¥,(z) (including œj) is 
element-wise invariant under M (k, a) for k € K™ and has dimension g™ + gq". 
It follows from (8.11) and Lemma 3.1 above that this subspace is invariant 
„under M(k,«) for kE K and transforms according to ta, under M (k, a). 
For any gE G we put 


(4. 4) Mi(g, a) E <M (g, a) Yj Wp. 
We proceed to compute these (q” -+ q”*)* matrix coefficients for ge A. Let 


g be given by a matrix e 9 with a€ 0%. We write (4.5) a= "y where 
n=ord(e) and E U. 
For j3€£%5’ we have, using (3.15) 
mi? if axe Ph+ j 
4.6 M (g,a4)¥,(z) = a(a)¥ joa . ; 
(4.6) (9, 4) %4(2) =a (a) ¥4(a0) ee 
Let us first consider %y(ar)%,(z) for lED. We put j—r%e and 
l= rd with p and v<m (since j and } are representatives mod R=) and 
g€€U. Now F(z) —0 unless rE P™ -I= 4 d, ie t= rE + ore’ 
with é€ ©. Let us assume n= 0 Then as = "ng + rrey € B™ + re if and 
only if rein— rre EP”. If this is satisfied then ze Pr re? implies 
az € 3B" 4 r#e whence l 


Un) f a(a)gr de= a(a). 
This proves 


Lemma 4.1. Let j= re lærte, p< m, vn, EU, CEN and 
n=orda Z0. Then 

a(a) if dy — rre E Br 

(£7) Malga) 1 0 if hey — he d Pr. 


Note that if j == 0 this condition becomes ne Pr, i.e. v= m—n. Hence 
in particular 

_ Sale) if ord(l) == m—n 
(4.8) Ma(g, 2) en 


If 7—=0 then s=” implies ac——7™*£,€ P” (since n>0) so that 
az EB" -+ j only for j —0. 

a(a) if j=0 
(49) Halga — Bar 
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Let us also note that if j is a unit, i.e. p==0 then the condition of 
Lemma 4.1 becomes r” ER” which is impossible unless y+n—=0, ie. 
v=n=0. Hence in particular 


(4.10) Mn(g,a) —=0 if jE U, 1ER and p20. 

It remains to compute My„(g,«) when j or J are of the form 7’. Let 
us consider first the case j = oj’, i.e. j=wj with 7E andle D. We note- 
that 

W;(ac) = 0 unless (ar) tE Pr -+ 7’, ie. 
1S—n—ord(z) Sm, i.e. —n— 1 Z ord(s) 2—m—n. 


But Wi(z)—=0 unless ceR"4+71C0. Hence if n=orda>0 then 
(at) %,(2) 0 for all z. This proves 
(4.11) My(g,%) = 0 if j= wy’, LE O and ord(a) = 0. 

Now we compute My(g,a) for jE O and l= wy, JED. By (4.1) and 
(4.2) we have 

0 if aef BM + j or ote BM + 

1a), REE) | qra(a)a(x)-? if az € P” + j and rier 7’. 
Thus we have to consider ze [a> (®"+7)] N [R*+ 7]. Let us write 
j= tře, f= rd with ee € Uand0Spyv<m. Then zE a~ (P” -+ 7) means 
Lae My t (ME rte) == rett (e + ré) with EED. On the other hand 
ze (Pr) means m= rE p e mr (d Harg) with FED, ie. 
zer (e A rE) r1 4 rE) with (ef. So we must have 
p= n — 7r, d =y and with ¿= eté 


(Lmg) m= (I + mr) ie TAE meet mer a 0, 


hence (7 = — regi + emey, Since £€ 0 and “€O and p <m we must 
have ord = max{0,n—v}. In particular we have proved that 


(4.13) Ualge) =0 if l= w7, j= ert, f= ee with d,eE U and 
0S m y <m unless p= n — y, d =m yet. 





So let us assume now p= n— y, ==. Then 
EED ifusSrv 


g= r” te(L +7 H#E) with je Ber if p>v. 


Thus 


pa “ reitet) if Sy 
mtl eE) if p> 
with é varying over ©. Let us consider the case a Sr. Then 
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a(x) a a(rfate)a(1+r4£) with EED. 


If p= 0 then a(1-+-7€) —1 since a, is a character mod H”, so that in this 
case 


S a(a)yy (ax) f(z) de — a (a) gra (arte) f d[ae(1 + 7”g)] 


== ga (a) &(a?)a(e)| a+ | J E-r for Rs = 4. 
If p > 0 we get 
a(a)qgra (aert)? $ &(1-+ rag) -ad[ ater (1 + TBE) ] 
= a(rt)a(ar)a(e)gmnn f a(t +) for B= h, 
so that for 0 < wp we get 


0 if a(14+ 8A)? 1 
(4.15)  My(g,a) = erben. if a(1 + Pr) = 1. 


Note that a, is a primitive non-real character mod ®”, hence so is a,? unless 
q is a power of 2. Hence 


(4.16) Mp(g,%)—0 if O0<pSv and (2,9) =1. 


The case » > v is the same as the case p <S y with p replaced by ». Therefore 
it remains only to consider j =0 or 7’ —0. 
If both j= 0 and j’—0 then we have 


Hong) f 2(4)¥o(a2)Fa(2)de—a(a)gn f a(x) de 


1-nSord #S-m 
eg D al) f° a(n)*dy—0 
since g? 5&1, 

If j=er (OS p<m) and 7 —0, then ws must have ax E Pa -j 
and zYEP”; but ga at (rME ter) == atri (e4 He) with ECO satisfies 
ze MP” if and only if p&n—m. Assuming this we get 

a(a) q” f à (1°) da =m a(a) gra (atre) fa(e + Tree) dla trk(ce+ rhe) | 
— a(a)a(at)a(r*#)gra(et) f a(1 + ore) tag 
G(r *)a(er)qra(e) f a(t + rmnsyag. 
D ' 


Hence if j= er (0S p< _m) and j’—0 we have 
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0 if p> n— m or if «(14+ Br")? 41 
IN Mad faide it nen m and a(1 Re. 
Hence if n=orda<m then M..(9,a@) 0. Also if q is not a power of 2, 
then «(1 + 9" #)?541 since «, is a primitive non-real character mod $”. 
This proves 


Lemma 4.2. Let j= ert, l= w}, fer with feu, 0OSp<m and 
lssvem. If (2,q) =1 then 


~1)\ mg pee I comm gh ey 
mos me en v, € =q and at. 
If q is a power of 2 the result remains the same when p= 0. 

If 0 <uSv then Mp(g,a) =a(a+)a(r*4)a(e?)g-* or 0 according as 
a(1 +Prr)—1orno. If0O<p<y then Myn(g, a) =a(lat)älr?ta(e)g* 
or 0 according as a(1-+ 8”)? ==1 or not. 

If j= jf =0 then Moo(g,%) = 0 since a331. If j= ert and f —=0, 
then Myo(g,%) is given by (4.17). 


From this we conclude at once 
Lemma 4.3. Let j and l be as in Lemma 4.2 above. Then 
= My(g,a) =0 if n=orda > 0. 


Proof. We may assume « such that M (g,a) is unitary. Then My(g,a) 
= Mp(g*,a) so that we are reduced to the case n < 0 of above Lemma 4.2. 
It remains to consider the case }, V with l= wj, VY = w7, j = er”, } = d'7. 
Then i 


<M (g, a) Yr yry = <M (9, a) M(t, a) Wy, M(w, a)yp) Sr <M (g5, a) Wy, (79 


so that we are reduced to the case Mj, with n < 0, and 5,7 ED. As before, 
yy (x) = 0 unless z E Pr -+ e7’, i.e. r = rf -+ re with ECD. But y(ar)=0 
unless ar € P™ -p erë i.e. T= y tf Ste” with FED. Since n<0 
now, zE P™ + e'r” implies s € P™* +. Therefore yj (ar) yy (x) == 0 unless 
en ren — FEW". Assuming this we obtain for n < 0 


My (g, 4) = fa(a)g™ de= a(a) gr fd (air § + y erit) = a (a) qn 
This proves 


Lemma 4.4. Let L= wj, V =w, j7 EP, we write j= e”, Fedr 
with pand v= 1. Then for n= orda > 0 we have 
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-1 -1 = € Pm 
Melpo) = SEO E F enere 


THEOREM 4.1. My(g,«) is given by the following matris" 


++ -a@(a) o0 : 
| a(a)*a(e) ig" 
0---0-+-0---0 -or 0 
u 0--:0- +05 +0 : 
0° --0-++O0++ +0 
af 0---0---0---0 a(a)-t¢* or 0 
a eat 
P u. © 


5. The mapping [> F(a). We now wish to study the integral 


(5.1) J, HOM (g.4)* dg 


for fe S. We introduce in the representation space of M(g,«) a complete 
orthonormal set which is adapted to the decomposition under M (k, a), ke K, 
i.e. we decompose the Hilbert space under M(k,a) into a direct sum of pair- 
wise orthogonal invariant irreducible subspaces and introduce an orthonormal 
base in each of these subspaces; their union is the complete orthonormal base 
which we shall use. 

The representation u == ta, of K introduced in §3 above occurs exactly 
once in the decomposition under M(k,a), ke K, as we have seen in $3 above 
(see Theorem 3.1). Let us denote the corresponding subspace by b. It 
follows from the orthogonality relations on K that all the matrix coefficients 
of F(a) = ff(g)M(g,%)* dg vanish except possibly 


(5.2) <3 (a) ¥, V for %, and Web. 
Now 
<B(a)%y t= f FO) Bulg a) dg 
a 
where 
(5. 3) My(9; a) = <M (g, a) Ty vy». 


If e(k) =rug(k) =r<M(k,a)% Yi in accordance with (2.1), then 
orthogonality relations on K imply moreover that 


"If g is a power of 2 then a(a*)a(7“*)a(e)g* can occur instead of a(a*)a(e*) g* 
in the last column. 
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(5.4) . Ila) tn Fo =0 if (j1) # (5i). 


Hence there remains but one non-zero matrix-coefficient namely 


(5.5) Blatt = f f(g) Hut 04. 

It follows that the mapping 

(5.6) f> D(a) Ea V) 

is for each fixed « a homomorphism of the algebra S,° to the complex numbers. 


We wish to evaluate the integral on the right side of (5.5). For this 
purpose let us make the following observations. Let h(g) € Sy and let ha(g) 
be its matrix coefficients with respect to the above basis in b; we assume that 
ha(g) is integrable on compact sets. By Lemma 2.1 there exists an element 
f(g) of 84° whose (i, i)-th matrix coefficient is 1/r times the above f(g) € Su°: 


(5.7) f(g) = Ein(g)] with rfu(g) =f(9)- 


Hence 


S iodbala)dg f, S Erfurt halky) kan (Ky) 


=f Í. 2 È un(k) Fin (y") ta (È) Zt (k) rly") ZuE) dk M(Ky"K), 


using the definition of Su, i.e. (1.1) and the normalization of the measure 
on K:M(K)=1. Now let us apply the orthogonality relations on K and 
we obtain 


(5.8) STR, Zina NEyE) 
this proves 


Lemma 5.1. Det f(g) € 82° and h(g) € 8, with Hg) = [hin (g)] where 
hm(g) ts integrable on compact sets. Then (5.8) holds. Hence in particular 
Si(g)hu(g) dg is independent of +. 

We apply this with ha(g) —My(g,a). The conditions of Lemma 5.1 
are clearly satisfied, in particular if M(g,«) is unitary then Mp(g,a) is even 
a bounded continuous function on G. As we now know that (5.6) is indepen- 
dent of 1, we may write for any f(g) € Se? 


6.9) F(a) = Ele) YD = f(g) Eu (g, 2) dg. 


So far we have only used in this section that the irreducible representation 
u of K occurs exactly once in M(k,a). Now let us use the explicit repre- 
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sentation u = Ua, discussed in §3 (see in particular (3.3) and (8.5) above) 
and let us insert the explicit expression for My(g,a) computed in $4 (see 
Theorem 4.1). We set g= 4”, i.e. ar" and obtain for any f(g) €84, 
using Lemma 6.1. 


Fa) —r{ Fu) +E È fal") Luly" a) MEE) 


= Stu) + Ela) I a 
Häl)" E falyr)a(ey)? 
GEH 
+a(r™)q" Z faly")]g"*(¢+1)} 


Gul) HIT 
using M(Ky’K) = q""(¢+1) for n=1, M(K)==1 and the above expres- 
sions for Mn(y",«) (see $4 above). Let us note that r=g"r+ gt and a 
is such that M(g,«) is unitary. Hence by Lemmas 3.2 and 3.3 « must be 
of the form a(r%) = q™Ha,(7); moreover a, is a fixed character of U. 
Hence, writing 


(5.10) F(a) =F + i) when a(7*y) = q'a, (7), 
we obtain 

(+P) — full) 
(6.11) Slee I far) ten E faale) 


+ UT i PRE (yr) ] g’i(g + 1) a 


Here (j,}) € I means that 7,2 varies over those indices for which My(y*, a) 
=a(y*) (see Lemma 4.1), similarly (j,2)EIT if and only if Mp(y*, a) 
= 0(a)"'g”a(e)? as given by Lemma 4.2 and (j,!)EIII if and only if 
Myp(y",a) =a(y") gq as given by Lemma 4.3. Hence writing 


fr(y*) = te fey") fa") =a paal)? 


(5.12) 
fulg") = $ faly") 
Gwe 


we obtain 
(a + g"") F(4 + st) —f(1) 
(5.13) = 2 Lore Pfs(y”) +) + g Daly") (gq +1) 


E Sra +g fly) + g aly) + farl) lel + 
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Br l 

noting that fy(1) = r>f(1) so that E fy(1) =f (1) for fe 8. with fa(g) 
i = 

defined by (5.7). I£ q is a power of 2 the set II has to be split up in 

accordance with Lemma 4.2 and expressions (5.13) and (5.13) have to be 

changed accordingly. 


6. The Plancherel formula for the subspace S,*. For fixed a, and 
varying ¢ we have thus found an explicit expression for the map > F ($ + it) 
for any fe 9.°, as given by (5.13). We shall now introduce a subspace of 
8 on which this map is naturally one-one. 


Definition 6.1. Let ©. be the orthogonal complement in S,? of the 
kernel of the map f—>F (4 + tt). 


We extend the map f—> F(4-+¢t) in the usual manner to S,* and then 
obtain 


THEOREM 6.1. Let ü—üx. be a representation in the principal series 
mod P” corresponding to a primitive non real congruence character x mod q”. 
Let u be the corresponding representation of K (see §3 especially (3.3) and 
(3.5)) and e(k) =ruu(k) for any fixed t—1,2,---,r (see (2.1) above). 
Then the map f>F(4-+4t) is a unitary operator of the Hilbert space ©? 
onto L?(0 StS 2x/logq; (q™-+-q™") dtlogg/2r). The inverse is given by. 


(6.1) f(g) — S FU + 8) Mg $+ N dilog glg + 9) /2e 


For any function F(} +it)e L? (0StS2/logq; dt) the integral (6.1) 
exists and defines a function f(g) € ©. 


Proof. As throughout œ, denotes the restriction of « to ANK=U. 
Let m, be the smallest integer such that a, (1 + PB”) <1. If x is a primitive 
congruence character mod 8" and if m4m, then by Theorem 3.3 ux does 
not occur in the restriction M(K,«) of M(g,a) to K. This implies that 
F(a) 0 for any such a. There remain only those a for which m, == m. 
By Theorem 3.1 ta, and %x must be equivalent representations, otherwise 
ux M(K,«). By Lemma 3.6 üa, and üx are equivalent representations if 
and only if a,==x or a, =x". It follows that for fe 8, 


(6. 2) F(a) =0 unless mı =m and a,—y or x”. 


Hence we let =x be fixed and let ¢ vary over the real interval 
O0StS2r/logg. Now we use the explicit form (5.13) of the map 
f-> F($-+11) which shows that F ($ -+ tt) is a finite Fourier series whenever 
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fe S.° and that this map is a bounded operator of 8, onto L3(0 StS 2x /log q; 
dt). The explicit form (5.13) also shows that this map is unitary on 8,7 
and in fact gives an explicit description of G8. 

Indeed if F(a) = 0 for all a then by (5.18) we must have 


(6.3) fr(y*) =fu(y") =fnr(y*) =0 for all n21 


and conversely. By definition of ©, any h€ ©, must be orthogonal in L?(@) 
to all f€ 8,2 which satisfy (6.3). Using Lemma 5.1 we obtain the following 
description of ©. 


Lemma 6.1. Let fe 8. and let us form the matric valued function 
fu(g) as in Lemma 2.1. Let (2,q) 1. Then FE GS? tf and only if 


(6.4) Fuly") =fim(y") for ainz1 


whenever (i,j) and (l,m) both belong to I, or both belong to III; tf both 
(15) and (l,m) belong to II then 


(6. 48) (a) fly) =a (ex) *fun(y*) for n=. 
If (i,j) € II ond (I,m) € II 
(6.5) fylg") = 9a) *fin(y”) for al n=1. 


The set of indices I, II, III are defined in §5 after (5.11). Moreover tf 
i, j does not belong to I, II or III then 


Moreover tf ìi, j does not belong to I, II or III then 
(6.6) fu(y*) =0 for all n=1. 
Now let us integrate (5.13) with respect to ¢ and we obtain 


(6.7) ID = (arom) [FE + it) attog g/2r. 


This implies the inversion formula (6.1) and hence the fact that the map 
f>F($+it) is a unitary map onto 


Lr (0 StS w/g q; dt(g + g™)log g/27). 
This concludes the proof of Theorem 6.1. 


7. The subalgebra 5. Let G? = ©. N 8.. One sees easily that ©, 
is a subalgebra of 9,° (with convolution as product). In fact we have 


THEOREM 7.1. Let u satisfy hypotheses of Theorem 6.2. Then the map 
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foF(4+it) is an isomorphism of the subalgebra ©,° onto the algebra of 
all Fourier polynomials I cag’. Hence every homomorphism of Sẹ? to the 
field of complex numbers is of the form [> F (s) for some complex number s. 
This is a *-homomorphism if and only if Rs = 4. 


Proof. By Theorem 6.1 the map F>F($-Hü) is one-one on ©, 
hence on ©. By the general theory of group representation it is homo- - 
morphism, hence an isomorphism. To prove that the image consists of all 
Fourier polynomials one only has to use the explicit form (5.13) together 
with the explicit computation of the matrix-coefficients Mp(g,a) (see $4) 
in order to write down for each power g"4# an explicit inverse image FE G,°. 

Indeed by Lemma 6.1 we know that &,° consists exactly of those FE S,° 
which satisfy (6.4) to (6.6). Let such an f also satisfy fr(y") =0 for all 
n= 0 and frr(y") =0 for all but one value of n= 1 then the corresponding 
F(s) is a constant multiple of g*@® for this n 21 and such elements of 8,° 
exist by Lemma 6.1. Similarly for n =]. 

Let us also note that if F (s) corresponds to f E€ © then by (5.18) there 
corresponds to f* the Fourier polynomial #(1— 5). Hence the *-homomor- 
phisms of the algebra ©,° corresponds to the points s with Rs — 4. 

Let us denote by ©,(v) the elements f of ©, which vanish outside the 
double coset Ky’K, i.e. we write 


(7.1) e(r) = ©, N Sely). 
We now have easily 


THEOREM 7.2. ©,(v) is a 2-dimensional vector space over the complex 
numbers for v= 1, tf q is not a power of 2. 


This is now an immediate consequence of Lemma 6.1. 


Definition 7.1. Let us denote by G,° the image of ©, under the iso- 
morphism (2.4) of Lemma 2.1. Let G,(v) be the space of elements of G,° 
which vanish outside the double coset KyrK. 


We note that ©, (v) is mapped onto G,(v) under the isomorphism (2.4) 
as follows easily from the above. 


Let us also write 
(7.2) Set Sev) 
y-0 


8. ©,°54S,°. We shall now study the space 8, in some detail, when u 
is the principal series mod P™. Let » be a fixed integer > 0 and consider the 


13 
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double coset Ky*K. We shall have to know how many linearly independent 
elements of S, vanish outside Ky’K. By §2 above this is equivalent with the 
` ` determination of all matrices X which satisfy 


(8.1) u(k)X —Xu(x) whenever ky” —y’x for k and x€ K. 


¥ Any such k must belong to K, where K, is the image under the natural homo- 
morphism GL (2,0) — P@L(2,0) of the group of matrices (ky) with hy € O, 
kıa € P and kike — kakan EU. Then k and x vary in (8.1) over all pairs 
where KE K, and x= y ky”. Let l 
(8.2) u,(k) =uly”’kyr) for ke K, 
then u, is a representation of K, and (8.1) is equivalent to 
(8.3) u(k)X == Xu, (k) for all ke K, 
Thus X varies over all intertwining operators between the repre- 
sentations u and u, of K,. 


Now we use the explicit form of u as principal series corresponding to a 
character y mod %", namely 


(8.4) [u(k)y] (2) = xl (kist + ka)” det Fly (Ge Te) 


where z varies over the points of the projective line over O/P” and the right 
_ side has meaning whenever (k€ -+ ka)" det k ¢ $. 
Let kE K, and x = y”ky”, then x is given by a matrix (xy) with xs, € Pr. 
‚For any positive integer 1< m let the function fı(z) be defined by 
x(e)? if T= ert 
(8) f(z) 0 otherwise 
where eE U (mod PR”). Let us assume now that væ m. Then 


KT (kip + Kae)" = Kuer? (Kızer! + Kae)”, 


but «zer? rn € U since 1>0 and xo, € Pr implies xz2€ U. Hence x maps 
Ur! onto itself by linear fractional transformation. Thus 


[u (x) fi] (£) = xl (x128 + roe)? det x] fr[ei1@ (xıs + Kae) *] 
== y[ (xazer? + xea)? det x ]y [ease (xer! + xa)’ 
u xL (det k) ki 27] 
which proves that 
(8.6) u(x) frm x (xi? det x) fr 
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Now if k is given by a matrix (ky) then x= y”ky” means 


kur?” ku) di =) 
AS: a ` > Ks e Kai Kee 
with c € QX, so that xı? det x == k? det k. Hence, noting that x is a character 
mod P”, we see that for kE K, 


(8.8) u, (k) fmm (k1 detk)fi—x(kas/kır)fi 


since we assume y= m so that kı? det k = kz2/kıı (mod P”) because kıs € Pr 
and kiks — kiska EU. 

Now let ve=— 2! as before and set again y.—u(w) > where yo is 
the characteristic function of PB” (multiplied by q™? as in $4). Then 
u(k)yo=ulk)yo therefore u(w)"u(k)yo =u(w>kw)yo Now wkw is 


given by the matrix 
ka — ka > ks — ii 
= kaa i) ( 0 kir ne) 
so that : 


[we (wthw) Wo] (£) = x| (— kans + kii) kuka lyol kas (ku — kas)*] . 
But yol heat (kr — kans) +] = 0 unless ze PB”, hence | 
(wth w) Yo = x (ka/k11) Yo 
ie. 


ulkw)yo—x(ka/kı)u(lw)yo 


hence 
ulk)yo—x(kas/kı)do for all k€ K, 


Thus if we combine (8.8) and (8.9) we obtain the following result. 


„Lemma 8.1. Assume that v= m. For each l= 1,2,: -:,m—1 the 
linear transformation, which maps Ya onto fı and the orthogonal complement 
of Ya onto 0, is an intertwining operator X as defined by (8.3). 


Now we consider the function f/ defined by 
(8.10) fi =u(w) fi 
Then for kE K, we have l 
[u (w)u(k) fi] (2) = [u (w>kw)fi] (2) 
= y| (— kas + k) det k]fi[ krs (ku — kaz) *]. 
Now if zer! then fı(z) =x(e)”* so that 
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fi (Ka2t/ ky — kas) = filer! (kr = kaier?) a 
= | Kove (kı — kaert) >]? 
hence 


[u(w) u (k) fi] (2) = x(k det k) = x (hes? detk)fi(e). 
Therefore 
7 u(k) fi — x (Kas? det k)u(w) fr 
= x (ka? det k) fy, 


but as before hy." det k= k/k: (mod H) and x is a character mod $”, 
so that we have proved 


(8.11) u(k)fi =x (kas/Kea) fi for all ke Ky. 


Next we determine u,(k)yo, ie. ulyrkyr)yo KER, As before let 
k = y”ky” then we know that « is given by a matrix (xj) with xz € P” so 
that, using again vZ m, we have 


` [tu (x) Po] (2) = xL (x127 + xan)? det xo] yo a) l 


which equals 0 unless z€ P™. Hence u(x}yo = x (x/xz22)ġo But by (8.7) 
K11/K22 = Keys / kee so that 


` (8.12) u,(k)yo =x (kun/kr)po for all ke Ky. 
Thus, if we combine (8.11) with (8.12) we obtain the following result. 


Lemma 8.2. Assume that v=Zm. For each 1=1,2,:°-,m—1 the 
linear transformation X which maps ys to fi and the orthogonal complement 
Of Wo to 0 is an intertwining operator as defined by (8.3). 


Now let us consider the function h(x) defined by 


(8.13) h(a) — fi 7 a zE © (mod P") 


Again we use kE K, and y= m so that kı: € W”, hence 
[u(k)h](z) = x(k? det k)h[ (ase + heer) baat]. 


But (kuas + har) hee € OD (mod P") if and only if zEeD(modPr) ie. 
hI (kut + ka)/ko]=h(z) so that 


(8.14) u(k)h—=y(k/kr)h for all k€ K,. 


Combining (8.12) with (8.14) we obtain 
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Lemma 8.3. Let y2-m. Then the linear transformation X which maps 
yo onto h and the orthogonal complement of Wo onto 0 satisfies (8.3). 


Now we consider the function k’ (s) defined by kh’ —u(w)h. We have 


[u(wt)u(x)h’] (2) = [u (w"xw)h] (x) 
= x[ («11 — kart)? det x] Rl woot (kis — Kail) =] 


whenever xı € P”. But u(wtTxw)hx(kg/rı)h by (8.14) so that u(x)h’ 
=yx(xa/xıı)h. Setting again k=y’ky” and using (8.7) we have as before 
K29/K11 = kez/kı; hence for r =m. 


(8.15) u,(k)h = y (k/k) k for all kE K, 
Thus if we combine (8.9) and 8.15) we obtain 


LEMMA 8.4. The linear transformation X which maps ya onto h’ and 
the orthogonal complement of Ya onto 0 satisfies (8.3). 


Thus, if we combine Lemmas 8.1 to 8.4 we see that there exist at least 
2m linearly independent matrices X satisfying (8.3). This proves 


THEOREM 8.1. Let u be a representation in the principal series mod P”, 
considered as a representation of K. Let v=m. Then there exist at least 
2m linearly independent elements of Sy which vanish outside the double 
coset Ky’K. 


If we combine this with Theorem 7.2, we obtain 


THEOREM 8.2. Let Üü, be a representation in the principal series 
mod P» corresponding: to a primitive congruence character y mod q™. Assume 
that q is not a power of 2. Let u be the corresponding representation of K 
(see §3 especially (3.3) and (3.5)). 

If m>1 then SPS, in fact Selv) ASslv) for vm. 


However when m == 1 we can show that ©, == Su. Indeed we have 


THEOREM 8.3. Let uw—wux be an irreducible representation of K 
belonging to the principal series mod P, corresponding to a non-real con- 
gruence character ymod P. Assume that q is not a power of 2. Then Sy = Sy. 


Proof. We consider again the restriction of u to the subgroup Ky. 
Since kE K, means kı € P” and u is now in the principal series mod, 
we have for kE K, 

(8. 16) [u()¥] (2) (kurt dot k) Y (ee). 


22 
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Hence the constant multiples ch of h form an invariant ray under u(K,) 
and so do the constant multiples ct, of Fe. Let p’ denote the orthogonal 
complement of the sum of these two rays in b. Then b’ is a u(K,)-invariant 
’ subspace of b of dimension g—1. It is easy to see that b’ is irreducible under 
u(K,). Similarly if ke K, then {c¥,} and {ch’} are two rays, each invariant 
‚under u(k). Let W” be the orthogonal complement in p to these two rays. 
Again one sees that b” is irreducible under u(K,*). We have to consider 
these. two irreducible representations of K,: The restriction of u(K,) to v’ 
and the restriction of u,(K,) to b”. These two representations of K, are 


inequivalent. Indeed let k be given by the matrix e 3 ): Then hk) is cane 


siy the matrix s I 


uk) =I. On the other hand u(k)) 34I as is seen at once, using the explicit 
form (8.16) of u as multiplier representation. But u,(k) ==u(k®), hence 
b’ and b” are inequivalent irreducible representation spaces of K, for each 
veoh, 2s. 

Hence the only possible intertwining operators X satisfying (8.3) are 
those between the rays {ch}, {ch’}, {co} and {c¥..}. By Lemmas 8.1 to 8.4 
(see algo (8.12), (8.14) and (8.15)) there are exactly two linearly indepen- 
dent ones in the present case m = 1. Using now Theorem 7.2 we have thus 
. proved Theorem 8. 3. 


Since y Z 1 and u is a representation haa B, we have 


9. Discrete series. We wish to construct irreducible unitary repre- 
sentations of G whose matrix-coefficients (with respect to suitable orthonormal 
bases) are square integrable functions on G. For this purpose we start with 
an irreducible unitary representation u of K, whose restriction to the sub- 
group of translations does not contain the identity representation, i.e. i 


(9.1) | ‘i ke 1J] DE 
We consider again the algebra S,°. If f(g) is contained in S,° then we have 
as above that f(ky”) =f(y’f) whenever kyr—y’t and y is given by the 
matrix i o Letting X = f(y”) for fixed v>1 we have as before 
(9.2) u(k)X —Xu,(k) for all ke K, 

(see $2 above). Now let z—(} ) then %0”) vr — (7 N But u 


is a continuous representation of K, hence there exists a (smallest) posite 
integer m such that u(K™) =I, hence 
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. om OV. = 
(9.3) . u EC. a1 I for v=m. 
Thus combining (9.2) and (9.8) we obtain for k= © K 


1 ií 
O «fC J yar 


But if we now use (9.1) we see that (9.4) and hence also (9.2) bas no 
solutions X other than X = 0. This proves 


) ana v‚zm 


Lemma 9.1. Let u be an irreducible unitary representation of K whose 
restriction to the subgroup of translations does not contain the one-represen- 
tation, i.e. (9.1) holds. Assume u(K™) =I. Then f(g) € Sy implies that 
f(g) vanishes on Ky’K whenever v= m. Hence in particular I, is a finite 
dimensional vector space over the complex numbers. 


It follows (see for example Mautner [4]) that the commuting algebra 
of the induced representation ind u is a finite dimensional *-algebra of 
Eta 


bounded operators on the given Hilbert space $. Hence indu decomposes 
into a direct sum of a finite number of irreducible representations, say U, 
of G: 
(9.5) § — XP 6, ind u = YOU, 

ja EtG A 
Let us note that if m—1, then f(g) vanishes on Ky’K for every v1, i:e. 
f(g) vanishes outside K and f(k) =cu(k) so that S, consists of the scalar 
multiples of the identity only; thus indu is irreducible in this case. - 

In any case let F; be the orthogonal projection of § onto 6% and f;(g) 
the corresponding function € 84°. Let v(g) be a column of f;(g) considered 
as a vector-valued function on G; clearly v(kg) —u(k)v(g) and v(g) is a 
continuous function of compact support satisfying f; *v =v so that ve 9O. 
Assuming QO (0) we have f,(g) not identically zero, so that v can be 
chosen 40. Now UW is irreducible and [U“(g*)v](g) =v(gg*), so that 
the finite linear combinations of all right translates of v are dense in §¥). 
Let us choose a countable dense subset of them and apply the Schmidt ortho- 
‘gonalization process: We obtain a complete orthonormal sequence „€ HO) 
such that each v,(g) is of compact support and continuous. Hence 


UP (9) vm — f” <om(29), (2) da 


is for each m, n of compact support on G. We have thus proved the tollowing 
result. 
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THEOoREM 9.1. Let u be an irreducible unitary representation of KE 
whose restriction to the translations does not contain the one-representation. 
Let U be the induced representation: 

U ind u 
Rte 
Then U is the direct sum of a finite number of irreducible unitary repre- 
sentations UW) of G. In a suitable orthonormal base the matris coefficients 
of each UY) are functions of compact support on Q. 


Let us note that representations u of K with the above property (9.1) 
exist, as was already known to Frobenius [1] and Schur [1]. 
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COMPACTIFICATIONS OF SYMMETRIC SPACES.* 


By Cauvir C. Moore. 


Section 1. Furstenberg in a recent work [2] has introduced the notions 
of a boundary and of boundary subgroups of a connected Lie group. If G is 
a semi-simple group with finite center and K a maximal compact subgroup, 
then these boundaries can be used to compactify the Riemannian symmetric 
space G/K. In this paper we shall study in detail the structure of these 
boundaries and the resulting compactifications. Also we shall show that this 
construction leads to essentially the same compactifications which Satake [8] 
has studied. Some of our results are in Satake’s paper, but we need them in 
modified forms. Hermann has also studied these boundaries and has obtained 
many interesting results, [4,5], using more geometrical methods. There 
is some overlap in the results. 

We shall briefly recall Furstenberg’s results and establish our conventions. 
Let M = G/H = {xH ; ze G} be a homogeneous space of the separable locally 
compact group G. If p is a Borel measure on M and g€ G, we define the 
translate g'u of » by the formula g-a(E)=u(g*:E) for a Borel set E. 
Then Furstenberg calls M a boundary of G and (H a boundary subgroup) if 
M is compact, and if for any probability measure „ on M, we can find a 
sequence g„ € @ such that ga'p tends in the weak-* topology to a point mags. 
(A sequence un converges to » in the weak-* topology if and only if 


SF apn ff dp 


for any continuous function on M.) We observe, [7] that on M there is a 
unique equivalence class of measures (called quasi-invariant measures) whose 
null sets are invariant under translation by G. Then Furstenberg has shown 
that for M to be a boundary it is enough that M be compact and that there 
is a quasi-invariant probability measure » on M and a sequence g, in @ such 
that ga'p tends to a point mass on M in the weak-* topology. 

Further Furstenberg shows that there exists minimal boundary subgroups 
and all such are conjugate. Moreover using the Iwasawa structure theory [6] 
one can see that there is a normal subgroup L of G such that L is contained 
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in a minimal boundary subgroup H of G (and hence all) such that G/L is a 
semi-simple Lie group with finite center. Since L acts trivially on G/H, it is 
clear that all questions of structure can be reduced to the case when L == (0). 
We shall thus treat just this case. i 

If G is a semi-simple linear algebraic group, then Theorem 1 implies 
that the boundary subgroups of G are exactly the parabolic subgroups in the 
sense of Borel-Godement [10]. Some of our results can be obtained using 
this theory. 

In Section 2 we shall compute the structure of minimal boundary sub- 
groups. Sections 3 and 4 extend these results to all boundary subgroups. In 
Sections 5 and 6 we shall study the resulting compactifications of the sym- 
metric space G/K where K is a maximal compact subgroup of G. Finally in 
Section 7 we shall examine the connection with Satake’s compactifications [8]. 

We are greatly indebted to R. Hermann, H. Furstenberg, A. Koranyi 
and D. Wehn for many interesting and useful discussions of these topics. 


Section 2. In this section we shall compute the structure of the minimal 
boundary subgroups of G in terms of the known structure of G (a semi-simple 
group with finite center). For the-following see for instance [9]. Let go 
be the Lie algebra of @, g its complexification, f, a maximal compact sub- 
algebra of go and po the orthogonal complement of kọ in g. with respect 
to the Killing form. We can choose a compact form u of g such that 
u=f)+ib (i= V—1), and go=f+ po Let o be the involution of g 
having go as fixed points, and let f be a maximal abelian subspace of po; 
then we can find a subspace ih* C fo such that Jo = p -+ tht is a Cartan sub- 
algebra of gy. Let Z be the set of roots of g with respect to the complexifica- 
tion } of ho. The real subspace spanned by the roots is h--+)*. We choose 
a basis for h- -+ h* by composing a basis in h and one in h*, and: we fix once 
and for all the lexicographic order on 3. The conjugate linear automorphism ø 
preserves h and so permutes roots by (o(a) (H)) = a(o(H)) for a€ 3, H€}. 
Now % can be decomposed into three disjoint sets; &#*= {a: a,0(a) > 0}, 
3 —=— 3, and A= (a: a—e—o(a)}; it is clear that 3+ (3-) consists of 
those positive (negative) roots which do not vanish on §-, and A consists of 
those roots vanishing on §-. We write 





n = 4al Xa (ac 3+) 
w = Sel: Xa (ser) À 
where Xq are root vectors. Then n and m are nilpotent subalgebras invariant 


under o. We denote by n, and no their intersections with go. Then the 
following are known, [1] 
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1°. g=bthtn, as direct sum, and I,—} -+ no is a solvable 
subalgebra. ` 


2°. Tf m—ht+ tht + 3C- Xa («€ A), then m is a subalgebra of Ë.. 
invariant under o. Also m(mo==mN go) is the centralizer and nor- . 
malizer of 5 in f(%). 


8°. b=m+Hh+n, is a subalgebra normalizing n, and Io. 


Finally, let K, A, N, N-, L, M, be the analytic subgroups of G corresponding 

to fo D, no, No’, Io, and mo. They are all closed and G== KAN is an Iwasawa - 

decomposition. Let M and Hf be respectively the centralizer and normalizer ' 

of 5 in K. Then M, is the connected component of both M and M. 
The following Lemma is known, [1] and [8]. 


Lemma 1. Every coset of M, in M contains an element x such that. 
ad(z) (tht) =iht. Moreover M=M,'Z where Z = exp(th-) NK is a finite 
abelian group central in M. 


For the following, see [1] and [3]. 


Lemma 2. M normalizes N and B=MAN is a closed subgroup nor- 
malizing N and L. 


The main result of this section has been conjectured by Furstenberg. 


THEBORRM 1. Bis the normalizer of N and L and is a minimal boundary 
subgroup. 


Proof. Let B’ be the normalizer of N. Then B’ > B and by Bruhat’s 
double coset lemma, [1], and Lemma 1 any s€ B’ can be written z == b’yb 
with y € M such that ad(y) (sh*) = (tht), and with 0’,b¢ B. It follows that 
ad(y) permutes the elements of 3 and since y normalizes N, ad(y) permutes 
the roots of 3+ among themselves. If A denotes the open positive Weyl 
chamber in §- (i.e. {H: a(H) >0, a€ St}), then ad(y)A =A. Now ad(y) 
. as linear transformation on h- has finite order since M/M is finite. Therefore 
since A is convex, it is easy to see that ad(y) has a fixed point in A. But all 
the elements of A are regular ([1], p. 188), and if y centralizes a regular 
element of 5°, it centralizes all of §-. Thus y€ M and s€ B, and so B =e B’ 
as desired. Finally if x normalizes L, it normalizes N since N is the derived 
group of L. Thus z€ B’—B, but it is clear that B normalizes L and the 
first statement is proved. 

We now turn to the second part of the theorem. Furstenberg hës shown 
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that the normalizer of L, which is B, is contained in a minimal boundary 
subgroup. Consequently, all we need show is that G/B is a boundary. 

By the Bruhat double coset lemma, each B-z-B meets Min a coset of 
M, and B\G/B may be identified with M/M. Lets,- -Sẹ be elements of M 
representing the cosets of M such that ad(s))==bo. Let sy;—=aBe G/B. 
Then the orbit of B in G/B through s’; is 


B-82, = B/sBsy? N B == MAN/MA (ad (8) N N N). 


Since ad (s) permutes the roots of MUS, ad (s) nto C to -+- to. Now there 
are a finite number (n) of orbits of B on G/B. Consequently at least one of 
them must have dimensional equal to that of G/B. But we know that 
dim (G/B) == dim N- == dim N, and dim B-s’;—= dim N — dim (ad (s) N N N). 
It follows that the orbits B-&, of maximal dimension are characterized by 
ad (8) ttoM no = (0), or equivalently that ad(s) no == no". Suppose now that 
s, and s; represent two orbits of maximal dimension. Then ad(sj8;*) mo = to, 
and 3,871 normalizes to. Thus ssy*€ Band s,s, Therefore we find that 
there is exactly one orbit of highest dimension, Bs. Now the complement 
of B-s’, is a finite union of submanifolds of lower dimension and hence a set 
of quasi-invariant measure 0. Let P—s,1B-s’,; then G/B—P has quasi- 
invariant measure 0. We claim that P is the one-one image in G/B of the 
subgroup N- of G. By the above, every element of B-s’, can be written 
uniquely in the form ns,B for some ne N. Thus any element of P can be 
written uniquely as so™nsoB =— ad (s0) (n)B. But ad(sot) maps N homeo- 
morphically onto N- and our assertion is proved. We now identity P with 
no by n>exp(n)B for n€ ny. Moreover if a€ A and n€ ty, 


a: exp(n)B == exp(ad(a)n)a*B = exp (ad (a)n) B. 


Thus A leaves P invariant and acts on P just as A acts on mo” by the adjoint 
representation. Moreover ad(a) for a€ A on the complexification w of no” 
is diagonalizable with eigenvalues exp(a(loga)) for a€ $. (We use log(a) 
to denote the unique element of h* such that exp(log(a)) ==a.) These eigen- 
values are real and it follows that ad (a) on no is diagonalible with the same 
eigenvalues. We introduce coordinates Ya(a € 3°) on no and corresponding 
coordinates on P which effect this diagonalization. 

Now let He A= {H: a(H) > 0,a€ S*}, and let a;—exp(tH), and let 
p be a quasi-invariant probability measure on G/B. We claim that æ’ p tends 
to a point mass at B. Let f be a continuous function on G/B with compact 
support such that O=fX1 and f==1 on Sẹ where Syem{p: pe P and 
| ya(p)| $3}. Then | 
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S falan) = f Fam) dale) 
since a(P)=1. We now see that 


plais) S Í, f(a) du(e) £1. 


We may find d>0 so that a(H) >d for all «€ 3*, and consequently the 
eigenvalues of ar" on no all exceed exp(td), and TI, D Sveta Thus 
as im, 
12 (ar) Z w(Soexpitay) > a (P) = 1, 
and 
Sf @(ap) >1. 


Now we may choose by the weak-* compactness of the set of probability 
measures on G/B, a subsequence t, such that a;,- converges to a limit w. 
It follows that 


Sal. 


Since we can choose f to vanish outside Sa», it is clear that w is a point mass 
at the origin B in G/B. This holds for the limit of any subsequence a,,:p 
which converges at all. It follows at once that a,-» tends to a point mass 
at B. Our theorem is proved. 


Section 3. It now follows that any closed subgroup C of @ which con- 
tains B is also a boundary subgroup. We shall classify such subgroups in 
this section. Let a.,---,¢, be a fundamental system of roots of g with 
respect to our fixed order, and let + denote the restriction map of linear 
forms on hy to h. Then we denote by F the distinct non-zero vectors among 
the set {w(a,)}. Following Satake, F is called a restricted fundamental 
system for go. The vectors of F are linearly independent [8] and if a € X+, (a) 
= > nyy (yE F) where the ny are non-negative integers. 

Following Satake, we make the following definitions. If E is a subset 
of F, let A(E) = {a€ 32: r(a) = Sin, y (y€ E)} and let 3*(#) (3° (#)) be 
the remaining positive (negative) roots. Let h’(#) = {H€}: y(H) 0, 
yE E} and let §-(#) be the orthogonal complement of h- (FE) in p. Finally 
let H(E) be the complex vector space spanned by the Ha with a€ A(#). 
Since o(A(l#)) =A(#), h(E) is the complexification of ba (E) = (E) N go- 
Now it is easy to see that }o(H) = th (E) + (EZ) where h(E) = h(E) N tht. 
We let 

s(P)—H(E)HZC- X (aE A(F)) 
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n(E) =$ C-Xa (a€ 3*(#)) and similarly for m (E). 


Further let 
I(E) = ($ OU(#)) + n(#) and 
b(Z) =g(#) +I(E), where © denotes orthogonal complement. 


Since o leaves A(E) and 2*(E) invariant, these subalgebras are spanned by 
` their intersections with go, which we denote by go(#) and so on. Notice that 
g(#) is semi-simple and that I(#) is the radical of b(E). 


THeorem 2. bo(H) is the normalizer of no(E) and h(E), and is self- 
normalizing. Each bo(E) D bo and every subalgebra of go containing by ts 
of the form bo(F). 


Proof. It suffices to prove the first statement for the complexifications 
of these algebras. First we observe that 5 normalizes n(#) and I(E). Now 
if a€ A(E), BEX (E) and if a+ is a root, it must belong to (I). 
Thus g(#) and hence I(E) normalize n(#). IE He (6 Ob(#)) and 
a€A(H), then a(H)=0. Thus g(#) and b(#) normalize I(E). Since 
g=n(E)-+b(E), it suffices to show that no non-zero element of n (F) 
normalizes n(#) or I(E). Let X= $ agXp, BEI(E) with aa0. We can 
fnd HE} Oh(H) CI(E) such that «(H) 40. Then 


[H, X] — daa (H) Xa + ZayX, 


and this is clearly not in I(E) and X does not normalize I(E). Also X-a € n(F) 
and by inspection [X_o,X] is not in n(E) so X does not normalize n(E). 
Finally if X normalizes b(#), it normalizes [(#), the radical of b(#), and 
hence XEb(E). 

Now let co be a subalgebra of g, containing b, and let c be its complexi- 
fication. Since cD) c=h+>C-Xa (a€8) where 8 is some set of 
roots. We shall show that S—A(#)U3*(H) for some E. In fact let 
E = {y, y€ F and 3Xa€c: x(a) =—y}. Since $D AUX in virtue of the 
fact that c D b, it suffices to show that INZ—A(F)NY. Let a€ A(B), 
then a=— 3n; and if m>0, then r(a)€ HU {0}. If w(oy) =0, 
Xa,€bCc. If x(a) —y€ F, we can find a root 8 such that X,€c and 
a(B) = —y. Then it follows from [8], p. 80 that + 8 == — a,—3 nya, (aj € A) 
where (a) =y. But now X-a, is in the algebra generated by Xp, Xa, and 
Xa, (E€ A). Thus Xo, isine. Now v(a) —=r(&) = y and it follows ([8], 
p. 80) that either ay = œ in which case Xa, € c or that o(a) = + X ma 
(“€ A). We can argue as before that X_(a,)€c. But c is invariant under 
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o, so that Xo,€¢. We have now shown that if a€ A(B), and a=—3 nai, 
then m > 0 implies that Xe €c- But Ya is in the algebra generated by 
those X_«, with m>0. Thus Xa€c and a€ 8. Conversely, let a € SN. 

` Then a==—% ma, and if nm > 0, Xa, is in the algebra generated by X. and 
the Xa, It follows that if n, > 0, Z,€c. Then r(a%)¢€ HU {0}, and it 
is clear that «€ A(#). Therefore $SNIT—A(E)N%, and Theorem 2 is 
proved. 

Tf (7) = go(#) NE, then f(E) is a maximal compact subalgebra of 
Go(#) which also centralizes Ho (E). ([8], p. 83.) Let m,(Z) be the 
centralizer of po (E) in h. 

Let B(E) be the normalizer of no(#) in G, and let M(H) be the 
centralizer of Y'o (Æ) in K. The connected component B,(E) of B(E) is 
the analytic group of @ corresponding to b,(#). Finally let G(E) and 
K(E) be the analytic subgroups corresponding to go(#), and {,(#). These 
are both closed, [8]. Part of the following theorem is contained in [8], pp. 
91-92. 


THEOREM 3. All the subgroups B(E) contain B, and any closed sub- 
group of G containing B is of the form B(E). Moreover 


B(E)=M(E)-A-N 
and 
B(E)=G(E)-Z-L(P) 


where Z is given in Lemma 2. 


Proof. It is clear that B normalizes no(#) since B==B,-Z and B, and 
Z normalize no(#). Let C be a closed subgroup containing B. Then the Lie 
algebra co of C is equal to bo(#), and thus C D B,(H#). Now it will 
follow from the last statement of the theorem that B(#) —B,(E)-Z since 
Bo(#) = G(#)-L(#) and Z-L(#) = L(#)-Z. But since CD B D Z, it is 
clear that CD B(E). If x€ C, ad(z) must preserve co==bo(#) and hence 
also o(#) which is the derived algebra of the radical of b)(#). Thus 
zeB(E) and C—B(F). 

It suffices now to establish the decomposition assertions for B(E). 
Suppose now that an element s,€ M normalizes n,(Z) ; we claim that it must 
be in M(E). This is clear if E == F. In general let A’(#) be the positive 
Weyl chamber.in H- (2); that is {H: «(H) > 0 for ae 3*(#)}. Now ad(s;) 
permutes the roots of 3*(Z) since it normalizes n, (Æ), and hence ad (s) A’ (E) 
= A’(H). We may argue as before that ad(s,) has a fixed point in A’(E) 
and hence that s, centralizes Y- (E). 
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We now claim that B(E) CM(E)A- N. Let zeB(EF), then c= dsb’ 
with b,b’€ B and s€ MMB(E) by Bruhat’s double coset lemma. By the 
previous paragraph, se M(E), and we write z = s(stbs)b’. Since B= MAN, 
b=un-a-mwherea€ A,m&eMandneN. Further n = nn, where n€ N(E) 
and n€ exp(n’o(#)) where n’o(#) ==noMgo(#). (This is possible since 
no(#) is an ideal in no and n’)(#) is a complementary subalgebra.) Then 
T me § (sis) -8-*(n,am)s-b’, and it suffices to prove that s!n.se M(H):A-N 
since s€ M(E) and the final term is in B in virtue of the fact that s normalizes 
no(#). But ad(s) permutes the roots of A(E) and hence s’G(E)s—G(E). 
Since n, € G(#), sinıse G(#) C M(#)A-N, and we are done. 

We now need the following lemma which will be proved later by different 
methods in Section 7. 


Lexma 3. M(E) C B,(#)-B and hence M(E) C B(E). 


An immediate consequence is that B(Z) —M(E)-A-N which estab- 
lishes the first decomposition for B(#). Another consequence is that 
B,(#):B==B,(2):-Z—B(#). This proves the second decomposition formula 
for B(E), and completes the proof of the theorem. 

We remark in conclusion that G/B(#) contains a dense open cell P(E) 
which we may take as the projection of P into G/B(E). Alternately it is easy 
to see that P(E) is the one-one image of N-(#) in @/B(E) so that P(E) 
is identified with no(#) by the map N>exp(N)B(E). Moreover A acts 
on P(E) just as ad(A) acts on no (FE), and the complement of P(E) is of 
quasi-invariant measure 0. 


Section 4. We preserve our previous notations. The homogeneous space 
G/K is a symmetric Riemannian space of non-compact type. Furstenberg 
defines a compactification of G/K using the notion of a boundary of G. Let 
m*(G/B) be the space of probability measures on G/B, upon which G acts 
as a transformation group. Since K is transitive on G/B, there is a unique 
pE m*(G/B) invariant under K. Then g>g'a maps @ into m (G/B), 
and since » is K-invariant this becomes an equivariant mapping ¢ of G/K 
into m*(G/B). Then he shows that & is one-one and ¢(G/K) may be 
viewed as a compactification of G/K. Similarly @/B(E) carries a unique 
probability measure a invariant under K and one can define in the same way 
an equivariant mapping ¢s of G/K into m*(G/B(E)), the set of probability 
measures on G/B(H#). In general, however, ¢y need not be one-one. The 
next theorem considers this situation. We are indebted to R. Hermann for 
suggesting this line of proof. We first need a definition which is clearly 
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inspired by [8]. We shall say that a subset of the fundamental roots of g 
is a component, if it is the set of fundamental roots belonging to the com- 
plexification of a simple ideal of go. Two fundamental roots in different 
components cannot restrict to the same element of F so we may speak unam- 
biguously of the components of F. 


THEOREM 4. The map oz of G/K into m’(G/B(E)) is injective if and 
only if E does not contain any component of F. 


Proof. Let x be the K-invariant probability measure on @YB(E). 
Then ¢p is injective if and only if gu == p implies ge K. Now we may write 
g = kak’ with k,k'€ K and a€exp(A). Then if kak’-u—yn, we find that 
“un. Thus dg is injective if and only if a a=u implies a1. Now 
a acts on P(E) = no (E) linearly and as before we can introduce coordinates 
Ya such that ad(a) is diagonal with diagonal entries exp(a(loga)), «€ 3%- (FE). 
But now if Se= {p: Yalp) < e}, it is clear since «(loga) < 0, that a*S,—S, 
contains a non-void open set unless a(loga) =Q for all a€3-(#). But p 
vanishes on no non-void open set in P(E) so that p»—a-p» is impossible 
unless «(loga) —=0 for all a€ 3-(H#). Conversely if a(loga) 0 for all 
a€3-(#), a acts as the identity transformation on P(E) and hence on 
G/B(H), and so a` p= u, 

Thus ¢» is not injective if and only if there is non-zero H in A such 
that a(H) == 0 for all a € 3-(#). Let F; be the components of F,i==1,---,n. 
Then §---%-+ hy where hi is the annihilator of the F} for ji. Then 


A = [Į A; where A, is the closed positive Weyl chamber in br. If E contains 
4=1 


a component of F, say Fi, let OF HE Ay. Then «ex (E), r(a) =£ nyy, 
yE Fy, j1. Thus a(Z)—=0, and ¢g is not injective. 
Conversely, let 04 H € A be such that «(H) 0 for all ac 3-(#). Then 

H = $ H; with H,€ A, and we may assume that H,5<0. Now suppose that 
we could find y€ F,—#. Let a, be a fundamental root of g such that 
(a) =y. Let 8 be the highest root of a component of g which F, defines. 
Then r(B)=Sinyy (y€ F) with all n,21. Since y(H,) >0 for some 
yE F, B(H,)—8(H) >0. But clearly —8 EX (F) and we have reached 
a contradiction. Therefore # must contain F., a component of F. Theorem 4 
is now established. 

If E satisfies the conditions of the previous theorem we shall say that 
E is faithful and that @/B(E) is a faithful boundary. 

If H€ A, a replica of the argument of Theorem 1 shows at a'u tends 
to a point mass at the origin in @/B(E) where p is the K invariant measure 


14 
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on G/B(E). Now ad(k)a,K for He A and ke K are exactly the “regular” 
_ geodesics through the origin in G/K. Then ¢y(ad(k)aK) converges to a 
. point mass at k-B(E) in G/B(E). í 


Lemma 4. If E is faithful, then the normal subgroup L of G acting 
trivially on G/B(E) is the sum of the compact components of G, and the 
center of G. 


Proof. If geL, then g acts trivially on m’(@/B(E)). Since ds is 
injective and equivariant, g acts trivially on @/K. Conversely if g acts 
trivially on @/K, let exp(tP)K, PEP, be a regular geodesic such that 
¢u(exp(tP)K) converges to a point mass at be G/B(H#). Since g fixes 
exp(tP)K, g fixes the point mass at b in G/B(H), and consequently G acts 
trivially on G/B(#). Thus L is the subgroup of G which acts trivially on 
'@/K and thus is the sum of the compact components of G and the center of G. 


Section 5. We shall now examine the fine structure of $u(@/K). We 
shall assume that Æ is faithful since it will become clear that the general 
case can be reduced to this one. If D is-any subset of F, we denote by 
O(£) the orbit of B(D) through the origin in G/B(#). Then O(E)? is given 
as B(D)/B(D)OB(#). It is clear from Section 3 that B(D)nB({E) 
= B(DNE). Furthermore, we know that B(D) = @(D)Z-L(D) and that 
Z-L(D) CZ L(DNE)CB(DNE). Thus G(D) is transitive on O(#)? 
and 

O(E)P=@G(D)/B(DNE)NG(D). 


The subgroup in the denomenator is just the normalizer of n (DN E) in 
G(D). Since no(D N E) = (no(DN E) N go(D)) +no(D), and since G(D) 
normalizes no (D), B(D N E) N G(D) is the normalizer on. (DNE)Ng(D) 
in G(D). 

If we consider G(D) as a semi-simple group, h (D) is a maximal abelian 
subspace of g(D) © f,(D) and D restricted to h- (D) forms a restricted 
fundamental system of g.(D), [8]. Moreover the positive nilpotent sub- 

algebra of go(D) corresponding to END, which we denote by m (EN D)?, 
" is just mo(H#MD) A go(D). We have therefore proved the following lemma. 


C Lemma 5. D is a restricted fundamental system of go(D) and O(E)? 
is the boundary of G(D) corresponding to the subset EN D of D. 


It follows that O (E)? contains a cell which we denote by P(#)?. This 
cell may be identified with no (E N D)? by the map n—>exp(n)-B(E). 
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It may happen that two different subsets of F yield the same orbit by 
this construction. We shall call a set D H-connected if no component of D 
(where D is viewed as a restricted fundamental system of G(D)) is contained, 
in END. Note that this says that O(#) is a faithful boundary of G(D). 
We first need some elementary facts about H-connected sets. Since the proofs ` 
are straightforward and tedious we shall omit them. 

If D’ is any set of F, let D” be the union of the components of D’ which 
are contained in FND’. Let D==D’—D”. 


Lemma 6. D is the unique maximal E-connected subset of D’. 


Lemma 7. Let D be E-connected; then 


D” = {y: yE E and y is a component of DU {y}} 
= {y: yE E and DU {y} is not H-connected}. 


Further D’ = D” U D is the unique maximal subset of F which contains D 
as maximal H-connected set. 


We now proceed to the principal results of this section. 


Turorem 6. (1) If D'C F, and D is the mazimal 2 connected subset | 
of D’, then O (E)? =0(E)®. 


(2) If D and C are E-connected, and O(E)P—=O(E)F, then D =C. 


(8) If D ts E-connected, then the largest subgroup of G mapping O(E)? 
onto itself is B(D’) where D’ is defined in Lemma Y. 


(4) If g€G maps O(E)D onto O(E)¢, then 0(B)? —0(B)¢. 


Proof. (1) D is a union of components of D’ and so defines a union of 
components of a fundamental system a, ` `, €m of @(D’); namely those a; 
such that there is a root a of G(D’) with «= Sinja,; and m>0 and m>0 
for some % such that m(ax) € D. Let rẹ be the semi-simple ideal of g,(D’) 
which is the sum of the other components. Then it is clear that r, and 
Go(D) span go(D’) and that go(D) Nro is the sum of the compact com- 
ponents of go(D). ; + 

We claim that ro C ba (E N D’). It suffices to show that r C b(E n DY: 
where r is the complexification of ro But r= (rb) + SC-Xa (ac 8) 
where S is some set of roots. We observe that HC b(E N D’), and if a€ g9,- 
then (a) =E nyy yE DCEND. Thus «€ A(E N D) and Zaeb(ENDN. 

Let R be the analytic group corresponding to rẹ Then it is clear that 
G(D’) =R-G(D) =G(D)R. But now O(E)?”' = G(D’)/B(EN D) N G(D’) 
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and sine RCB(END), O(E)?”=G(D)/B(END)NG(D)=O(E)?. 
This argument also shows that R acts trivially on O (EJP. 


(2) The natural map of no (E) into @/B(E) is injective and n (END)? 
is the subset mapping into O(E)P. It follows that if O (FE)? = O(H)°¢, then 
w(EAD)P=r(ENC)*®. Buat m (EN D)? == C-Xa« over those roots a 
such that (a) =— X nyy (y€ D) with at least one ny > 0 for yE D— E. 

Thus if D and C are Z-connected and O (E)? =O(H)¢, it is clear that 
D—E=—0— E. We show now that DNE=C0NE. If BEDNE, then 
we can find, since D is E-connected, a root «€ A(D) such that (a) == — $, ny y 
with ns>0 and ny>0 for some yeD—E. Thus Xac w (DNE) 
=n (CNE). Sinceng>0,8E€ CNH and soDNHECCNE. The reverse 
inclusion follows by symmetry, and we are done. 


(3) The subgroup of G which maps O(E)? into itself must contain 
B(D) and hence is of the form B(C’) for C’D D. It is clear that O(H)? 
=0O(F)°. We assume that D is H-connected and let C be the maximal 
E-connected subset of O”. Then 0(#)2 =O(#)© and so D =C by part (2). 
Hence in the notation of Lemma 7, C’ C D’ since D is the maximal H-con- 
nected of C’. But by part (1) O(E)?”’—=O(E)? and so B(D’)D B(C’) and 
hence D’D ©. Thus 0’ —D’ as desired. - 


(4) Suppose that ge G maps O(E)? onto O(£)© where B(D) and 
B(C) are subgroups of G leaving invariant these orbits. We may assume 
that g maps the origin into the origin; that is, ge B(E). Also if b,b’EB, 
bgb’ will do the same, and by Bruhat’s lemma we make take g =s, an element 
of M. Now it is clear that sB(D)s*—=B(C) and since s € K, sM(D)s* = M(C) 
using the first decomposition of Theorem 3. It follows at once that s maps 
the M(D) invariant measure pp on O(E)? onto the M(C) invariant measure 
po on O(E)E. 

We shall now make use of an argument due to Satake, [8], p. 98. Let 
HEY and g;--exp(tH)K be a geodesic in G/K. We shall see later that 
a(H) =0 for a€ A(D) and a(H) <0 for ac 3-(D) are sufficient conditions 
that ¢a(g:) converge to up (The M(D) invariant measure on O(#)?). Let 
H and H’ be in the closed positive Weyl chamber A of h and satisfy these 
conditions relative to D and C. Since ad(s)b(D) —b(C), and ad(s) permutes 
the roots of g, it follows that ad(s)x°(D) =X (C) and ad(s)A(D) =A(C). 
But now it is clear that H(A) = (1—A)H-+As“H’ satisfies the conditions 
above for D for A:0SAS1. Hence ¢a(ge(A)) converges to pp where 
g:(A) = exp(tH(a))K. Now H(0) =H CA and H(i) —=s*H’€ std. Thus 
we can find a finite sequence 8 == e, 8,,' * *, S =s% in the Weyl group of §- 
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such that for any A, H(A) € s,A for some i, and for each i, there is a A; such 
that H(A) E 3A NSA. But then ssu” must fix H (à) and hence (A). 
Hence su! (up) =un- It follows then that sup = up = po, and O(E)? 
== 0(E)C. Theorem 5 is now completely proved. 

Let D be an E-connected set and let D’ be the maximal set such that 
O(E)P—=O(E)?. Now G(D)/K(D) is a symmetric space of non-compact 
type. We seek a homomorphism w(H#,D) of B(D’) into the group of iso- 
metries of G(D)/K(D). This has been defined by Satake, [8], p. 97. We 
shall reproduce this here. We observe that Z normalizes G(D) and K(D) and 
ZNG(D)CK({D). Further Z preserves the Killing form on 9(D). Thus 
Z:@(D) will act as a group of isometries of G(D)/K(D). ER is the sub- 
group of G(D’) defined in part (1) of Theorem 6, G(D)-ZN (BR: L(D’)) 
is a normal subgroup of G(D) -Z contained in K(D) and hence acts trivially 
on G{D)/K(D). We observe that 


B(D’)/R- L(D’) = G(D)-Z/G(D)-ZM (R-L(D))=J. 


Now define w(E, D) =1 on R-L(D’) and w(E,D) is determined naturally 
by the established action of J as a group isometries on G(D)/K(D). 

We know that O(E)? is a faithful boundary of G(D) since D is E- 
connected. Let $4 ng denote the embedding map of @(D)/K(D) into 
measures on O(E)?. We preserve the previous notation. 


THEOREM 6. B(D’) ts the largest subgroup of G which leaves the range 
of ng wariant. Moreover 


bb ay (8) = b2 (WED) (d)s) 
for be B(D’), se G(D)/K(D). 


Proof. First if g leaves the range of $3 invariant, then g-pp 
= $S ag (S) for some s, where wp is the M(D) invariant measure on O(E)?. 
But pp and $? ay (S) both have O(E)? as support. Thus g maps O(E)? 
onto itself, and by Theorem 5, ge B(D’). 

It suffices now to prove the formula stated in the theorem. If b€ B(D’), 
we can write b==g-z-lwhereg¢ G(D),z2¢2Z,1¢R-L(D’). It clearly suffices 
to check the formula for g, z, and l separately. Now R-L(D’) is a normal 
subgroup of B(D) contained in B(E N D) and so it acts trivially on O(E)?. 
Since w(Z,D) (1) =1, the formula is immediate if b=}. If b==ge G(D) 
the formula holds by definition of ##,,,. Finally if g =z, let s =t: K(D) 
for tE G(D). Then z- pog (S) =2 pp —ziztun since z€ M(D). But 
now w(E,D) (2) (s) = (ztz7)K(D) and so 
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Ban (w(E,D) (2) (8)) zierte (8) 
as desired. 


Section 6. We continue with the same notation. Our main theorem 
gives the orbit structure of Furstenberg’s compactifications. 


THEOREM Y. The closure $u(@/K) of the range of $a consists of the 
union of the G orbits of the finite set of measures pp as D runs through the 
E-connected sets. Further these orbits are disjoint from each other. 


Proof. Let u be the K-invariant probability measure on G/B(E). 
Then ¢y(K) =u and d5(@/K) is the closure of the set of measures g' m, 
g€G. Let „EG such that gop”. Now ga = krank, with kp, kh’, € K, 
mE exp(Ä). Then gap == kplan. We can choose a subsequence {m} such 
kn, > k and dy, has a limit. Then ka. 2’. We now need the following 
lemma. 


Lemma 8. Let a sequence una of measures on G/B(E) converge to p, 
and let „>gin G. Then gn pag’ p 


Proof. Let f be a continuous function on G/B(#). Then it is easy to 
see that f(g.v)-> f(x) uniformly for ze@/B(E). Let |a| SM (M is 
finite by the uniform boundedness theorem). Then 


| SFAI: u) — SF Alga un)| 
S| ff (9x) due) — ff (gz) dus(z)| + f] f(gz) —f (gxt) | dyn (2). 
The first term tends to zero, and the second term is majorized by sup | f (gz) 


— f (gaz) |: M which also tends to zero. Therefore the lemma is established. 
We continue with the proof of the theorem. By the lemma, 


K” mee k: lim (an, p) = kp. 
We only need show that WE @'pp for some D. 


If p’==limexp(H,)p, we can choose a subsequence of H, (which we 
denote by the same symbols) such that a(H,) either tend to -+œ or to a finite 
non-negative limit for any a € X*+. Let D be that subset of F such that y(H,) 
tends to a finite limit. Now we can find a sequence H”, in A such that 
y(n) =y(H”,) for y€ D and y(H”,) =0 for yé D. It follows then that 
H”, tends to a finite limit H” in A. Let H’,—H,—H”, so that y(H’,) = 0 
for yE D and y(H’,) =y (Hn) 20 for yg D. Then H’,€ A, and exp(H,) 
= exp(H”,)exp(H’,). We may assume, if necessary, that exp(H’,)p tends 
to a limit y. Then by Lemma 8, 
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w — lim exp (Hy) u—~ exp(H”)v. 
Therefore it suffices to prove the theorem for yv. We change our notation for 
convenience so that H’,—H,. We first observe that H„ E Ņ-(D). If 
ke M(D) (the centralizer of 5’ (D)), then 
k- v= k- lim exp (Hp) p = lim exp (Hy) ku =v. 

Therefore v is a probability measure on G/B(#) invariant under M (D). 

Recall that P(E)? — exp (no (E N D)P)-B(E) is a Euclidean cell in 
O(E)?. We introduce coordinates yaa E€ X (E) on no (E) =P(E) such 
that ad(a) becomes diagonal with eigenvalues exp(a(loga)) and such that 
Yalzex(END)?) are coordinates on no (EAD). Let ya denote the 
corresponding coordinates on P(E). Now if «e 3 (HOD), x(a) = X nyy 
(y€D) and a(H,)—0. Thus a,—exp(H,) acts trivially on P(E)? 
=no(END)?. HE ag (EOD). Then x(a) =E nyy, where ny <0 
and at least one ng <0 for 8 € D. Then 


exp(a(H,)) Sexp(—A(H,)) and B(H,)> +. 
Therefore we can find a sequence yn tending to +o such that exp(—«(H,)) 
Zr, for any a€ 3-(#) —2 (END). 

Let R be a closed subset of P(E)? and let R’ and R” be two neighbor- 
hoods of R such that RC R'C KR CR”. Now let S(s R') = {2-4 z: rE R 
and Yya(z) =0 if a€ X (END)? and |ya(z)| <6}. Now it is clear that 
we can find a continuous function on P(E) such that 0OSfs1 with f—1 
on S (e, R’) and such that the support of f is contained in S(%,R”). Then 

ff dv= lim SF z)du(e). 


Since ad(a,)—=1 on no (END)? and all eigenvalues of ad(aẹw*) for 
ag 3 (E N D)? exceed Ta, f (an' £) = 1 on S(rne, R’) and f(a,°x) is supported 
lon S(%, R”). Thus we find that 


| a(S (te, R’)) S fF (ane) dp(z) S p(8 (0, R”)) 

| u(S(0,R’)) = ffdvSp(S(0,2”)) 

‘since p(8 (rae, R')) tu(S(o,R’)). Finally as B” |R 
u(S(0,”)) Lu(S(0, B)) 

since » is a finite measure. But as R” | R and «0, 


Sf dv v(B). 
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Thus we find v(R) =u(8(®,R)). 


I£ Rt P(E)», then p(S(o,R)) tp(P(#)) 1 and so v(P(#)?) —1. 
Thus since y is also a probability measure, y must live on P(#). Therefore 
the support of v is contained in the closure O(E)? of P(E)?. But M(D) is 
transitive on O(E)? and y is M(D) invariant. It follows immediately that 
v== up. To be more precise, let C be the maximal E-connected subset of D, 
then O(#)2—=O(#)© and y= up = po. 

We now must show that each up € ¢a(G/K). In fact let H € A such that 
a(H) =0 for a€ A(D) and a(H) >O for ac 3+ (D). Then the above argu- 
ment shows that if a; = exp(tH), then every subsequence of a; u which con- 
verges at all, must converge to xp. Thus &'a—>yun. In fact we can drop 
the condition that TEA. This then clears up the point which was left open 
in the proof of part (4) of Theorem 5. 

We further claim that the orbits G- yp are disjoint. For if g’ pp = h: po 
where D and C are E-connected, it is clear that hg maps the support O (E)? 
of up onto the support O(#)° of po. By Theorem 5 (3), D—C. Theorem 7 
is completely proved. 

Finally we clear up Lemma 3 used in the proof of Theorem 3. We take 
Ep and H an element of §’-(D) such that y(H)>0 for y¢D. If 
a; exp(¢H), then our argument shows that a, ‘u converges to a measure v 
which lives on exp(tto(D)) +B (m (D) is our notation for no™ ($)?.) and is 
M(D) invariant. Moreover v vanishes on no non-void open subset of this set. 
But it is clear that exp(n’,(D)) -B is contained in the orbit of By(D) through 
the origin in G/B. But this orbit is clearly closed, so that v is supported on 
B,(D) -B in G/B, and the support of v contains exp(n’.°(D))-B. Since v 
is M(D) invariant it follows that M(D) C B,(D)-B as desired. 


Section 7. In order to show the relation of these compactifications with 
those of Satake [8], we will need two more lemmas of a topological nature. 


Lemma 9. If E is faithful, oz is a homeomorphism of G/K into 
m*(@/B(E)). 


Proof. If ga E G, and g,° pu converges to gp (p is the K-invariant measure 
on G/B(#)), we shall show that gaK —> gK. If the set of elements gE, g,K 
remains in a compact set S of G/K, then ¢u is a homeomorphism on 8, and it 
will follow that g¢,K —> gK. Thus we write g,—=k,a,k’,, and it will suffice to 
show that log(a,) =H, remains bounded in A. If not, we can find a subse- 
quence which we may denote by H, and a proper subset D of F such that 
y(H,) > + for yé D and y(H,) tends to a finite limit for y€ D. We may 
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also assume that kı—>keK. We know that a,» has a limit » which is 
supported on O(E)P. Since E is faithful, O(E)? is a proper submanifold 
of G/B(Z). By Lemma 8, g'p= m gn' u= kv is supported on &-O(H)? 
which is a proper submanifold, But g-u has support equal to all of &/B (E) 
since it is quasi-invariant. This contradiction establishes the lemma.. 

Now let wx denote the map of A into m*(G/B(#)) given by ya(H) 
= ¢a(exp(H)). Similarly we denote by y2 p the obvious map of A(D) 
(the positive chamber in -(D)) into m*(O(#)®). 


Lemma 10. ya(A)—=U y2 pp (A(D)) over all E-connected sets D. 
Furthermore Yo o (Ha) converges to yon (Ho) tf and only f CCD 
and y(H,)—>y(H,) for y€C, and for every E-connected B such that 


CEBCD, there is a y€ B—C with y(Hn) > +0. 


Proof. The first statement was essentially proved in Theorem 7. We 
claim further that y2 ag (Hn) >YGag (Ho) if and only if CCD and 
y(H,) > y(Ho) for y¢C and y(Ha)—> +œ for y¢C’ where C’ is the 
largest subset of D which contains C as maximal E N D-connected set. This 
also follows immediately from the proof of Theorem 7. 
~ We only need show then that y(H,) > +, yé C is equivalent to the 
final condition in the statement of the lemma. Let y(Hn) > +» for yé C’, 
and let C Œ: B C D with B, E N D-connected. B cannot be contained in (* 
for otherwise C—B. Thus there exists a y€ B—C’, and we have y(H,) 
—> -+%. Conversely, let the condition be satisfied, and let yÉ ©”. Then 
{y} U C is END-connected. (If y¢ END, this is clear, and if y€ END, 
our assertion follows from Lemma 7.) Since 8(H,) remains finite for BE C, 
y(H„) must tend to œ, and we are done. 

Satake [8], constructs a compactification of G/K for each subset I of F 
such that every component of F meets J. We denote this compactification by 
(G/K); First we note that Z satisfies Satake’s condition if and only if 
F—TI is faithful in our sense. 


Tarorem 8. If E is faithful, ¢2(G/K) ts isomorphic to (G/K) rx. 


Proof. Satake gives a list of axioms 1°-4° on p. 100 which completely 
characterize (G/K)ra. We shall show that ġ¢a(G/K) satisfies these axioms. 
It is clear that ¢u(G/K) is a compact G-space and that G/K is homeomor- 
phically embedded (Lemma 9) as a dense subspace. 

For Satake’s second condition, we note that if p is the highest weight 
of a representation and (F— E) = Ap is the corresponding subset of F (see 
bot p. 102, [S] for notation), then a subset D of F is p-open in Satake’s 
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definition if and only if D is #H-connected in our sense. A: perusal of the 
definitions shows that Satake’s condition 2° and 3° are equivalent to Theorems 
3, 5, 6 and 7. Finally 4° is just our Lemma 10. 

Therefore the compactifications of G/K obtained by embedding into 
probability measures on a faithful boundary are in one-to-one correspondence 
in a simple way with Satake’s compactifications. 
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ON THE GRADED RING OF THETA-CONSTANTS.* 


By JUN-ICHI Ieusa. 


Introduction. Let g be a positive integer and let r be a complex sym- 
metric matrix of degree g with a positive-definite imaginary part. The set of 
such matrices forms a convex open subset of the $-g(g + 1)-dimensional 
complex vector space and (as a complex manifold) it is called the Siegel 
upper-half plane of degree (or “genus”) g. A standard notation for this 
is ©, Observe that ©, is the upper-half of the ordinary complex plane. 
We know that the group Sp(g,R) operates transitively on ©, as 


Hr—(t 3) t= (ar $2) (or a) 


and we get in this way (i.e. Sp(g,R)/+1s, is) the full group of analytic 
automorphisms of ©,. Moreover discrete subgroups of Sp(g,R) give rise to 
all possible groups of analytic automorphisms which operate properly dis- 
continuously on &©,. Among discrete subgroups of Sp(g,R), the importance 
of the Siegel modular group Sp(g,Z) is unquestionable. We consider a 
discrete subgroup T of Sp(g,R) which is “commensurable” with Sp(g,Z) 
(in the sense that the intersection has finite indices in T and Sp(g,Z)). 
An analytic function y on ©, which satisfies the functional equation 


(A - 1+) = det (er + d)*y(r) 


for every M in T (plus a condition at infinity for g==1) is called a Siegel 
modular form or simply a modular form of weight & belonging to T. We 
assume that the weight is an integer and then we conclude (unless y—0) 
that it is non-negative. The set of such functions forms a complex vector 
space A(T), and the graded ring 

A(T) baal ® A(T)x 

Eko 

will be called the ring of modular forms belonging to T. It is a normal 
integral domain and the theory of compactifications [1] shows that it is of 
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finite type over Á (T) = C and that the complex projective variety proj. A (T) 
[cf. 4, footnote 2], which we simply call the modular variety belonging to I, 
contains the quotient variety T\@, as a Zariski open set whose complement 
is of co-dimension (at least) two for g= 2. 

Now the problem we are interested in is the structure of the modular 
variety proj. A(T) and in particular the one belonging to Sp(g,Z). At 
present moment, there are three methods to investigate this problem. The 
first one is to study the variety of moduli.of curves of genus g and then to 
use the information so obtained for the investigation of the modular variety. 
This method works only for g 1, 2,8, but we can use the classical theory of 
invariants of binary quartics, sextics or ternary quartics according to the cases. 
In fact, in this way we succeeded rather recently in determining the structure 
of proj.A(8p(2,Z)) [4,5]. The second method is to study the variety of 
moduli of principally polarized abelian varieties. This method works‘ for 
all g and we can nse another legacy of the past, i.e. the theory of theta- 
functions. The third method is to work out a finite form of the Selberg 
trace formula and to apply this formula to the investigation of proj. A(T). 
This, when worked out successfully, will be the most general method. The 
purpose of this paper is to establish what we think is a fundamental lemma 
in the second method. In the following we shall give its exact statement. 

We shall write vectors in Z% by m,--- and we use m’, m” to denote 
vectors in Z° determined by the first and the last g coefficients of m. Now, 
if r is a point of ©, and z a point of CP, the following series 


Im(r,2) = Y old: (p+ m'/2)=(p-+-m'/2) 
+ (p+ m’/2) (2+ m”/2)] 


converges absolutely and uniformly in every compact subset of ©, x ©. 
Therefore, for a fixed m, it represents an analytic function of the two variables 
r and z, which is called the theta-function of characteristic m. Actually, 
since we have 


Om (T 2) — (— 1) mn On (7, 2) 


for any n in Z%, we sometimes normalize the characteristic by the condition 
that its coefficients are either zero or one. At any rate, if we put z==0, we 
get the so-called theta-constants 0m (7) = Om(r,0) and Om, which we also call 
theta-constants, are analytic functions in ©. On the other hand, for every 
positive integer n, we consider the subgroup T,(n,2n) of Sp(g,Z) of elements 
M satisfying = 


M=1,,modn, (a*b) = (c'd)) = 0 mod 2n. 
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In general, if s is a square matrix, its diagonal coefficients arranged in a 
natural order form a vector which is denoted by (s).. The subgroup T,(1,2) 
appeared already in the analytic theory of quadratic forms. At any rate, 
we shall show that the graded ring A(T,(4,8)) is the normalization of the 
graded ring C[0m8n] generated over C by the products of theta-constants. 
Namely the two integral domains have the same field of fractions and 
A(T, (4,8)) is the “integral closure” of C[@mOn]. If g is given, we can 
certainly determine the normalization of C[#m6,] explicitly and thus we will 
know the ring A(T,(4,8)). Then, by a going-down process, which is linear, 
we will know the ring A(Sp(g,Z)). Actually, in the two cases g = 1,2, the 
ring C[6m6n| itself is normal, and in the case g—2, we can reproduce our 
structure theorem with further important information. This will be dis- 
cussed in a separate paper. The comparison in the case g—2 shows that the 
second method is considerably simpler than the first method. It is free from 
the theory of invariants and we need not “blow up” anything (which was 
necessary to fill the gap between the two types of varieties of moduli). There- 
fore, it is expected that the calculation in the case g =3, for instance, is 
something of a manageable order. 


1. Congruence group E',(n,2n). As we already did in the intro- 
duction, we shall express a typical element M of Sp(g,R) in the form 


a b 
u-(; a) 
by four g X g submatrices a, b, c, d. We recall that Sp(g, R) is the group of 
2g X 2g real matrices M satisfying ME'M —E in which 


0 1% 
2-3) 
and Sp(g,Z) is its discrete subgroup of elements with integer coefficients. 
Observe that the condition MEH*M = E can be written in terms of a, b, c, d as 


ath == bta, cd = dic, aid — btc == 1y. 


If n is a positive integer, the principal congruence group of degree g and of 
level n is defined as a subgroup of Sp(g,Z) by the condition M==1,,modn. 
We shall denote this group by T,(rn). Observe that T,(n) is stable by M -> tH 
and that it is normal in T,(1) == 8p(g,Z). In general, a subgroup of T,(1) 
is called a congruence group (of degree g and) of level n if it contains T,(n). 
The group T,(n,?n) in the introduction is, therefore, a congruence group 
of level 2n. We shall use the following formula 
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[T,(1): Ty(n)] = wee TI TT i—p*), 
pinızkzy 


‘which we can find, for instance, in Koecher [6]. We observe that, if M is an 
element of T,(n) and n is even, we have (a'b),= (b),, (cd). (c). mod 2n. 
Therefore, in case n is even, we can define T,(n,?n) as a subgroup of T,(n) 
by the condition (d).=(c)o=0mod®n. In particular, it is stable by 
M—tM. We shall prove the following lemma: 


Lemma 1. If nts even, then (i) T,(n,?n) is a normal subgroup of T,(1) 
and its index in T,(n) is 279, (ii) Ty(n)/T,(2n,4n) is an abelian group, 
(iii) T(n, 2n) /T, (2n, 4n) is a vector space over Z/2Z of dimension g(2g + 1). 


Proof. If we express a typical element M of T,(n) in the form 


wef) 


with g X g integer matrices a, B, y, 8, the condition for this element to be 
in T,(n) is 
‘Bom B+n(Bla—ap),  ty—y-+n(y'8— sy) 
a+%+n(a'S—fty) 0. | 


We associate to this element of T,(n), a vector over Z/2Z whose coefficients 
"are (8), mod 2 and (y),>mod2. Then we get a homomorphism of T',(n)/T,(2n) 
to (Z/2Z)%. Since we can take «= y==ô==0, = arbitrary (integer) 
symmetric matrix, this homomorphism is surjective. Since the kernel is pre- 
cisely T,(n,2n)/T,(2n), the index of I,(n,2n) in T(n) is 277. Now we 
transform M by an arbitrary element of T,(1) composed of a, b, c, d. Then 


we get 
a E) 
1, +n , 


with 8’ ==— (aa -+ by)*b + (aß + b8) ta, hence 
(B )o=a(8)o + b(y)o mod 2. 


Therefore (8) = (y)o==0 mod? implies (#).=0 mod? and also (Y),=0 
mod2 (by a similar argument or by using transposed matrices). Hence 
T,(n,2n) is normal in T,(1), and this proves (i). We now consider two 
elements Mf; of T,(n) determined by a, fy yọ 8; for t= 1,2. Then their 
commutator is of the form 


tafi B) 


. ys 
with 
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An (a:b + Bata, — & ka — B;'a,) mod nê, 


hence (8,)o=0mod4-and also (ys)o=0mod4. Since T,(n)/T,(2n) is an 
abelian group, therefore, the commutator. group of T(n) is contained in 
T, (2n, 4n). This proves (ii). As for (iii), we first observe that squares of 
elements of T,(n,?n) are contained in T,(2n,4n). Then we have only to 
recall that the indices of T,(2r) in T (n) and of T,(4n) in T,(2n) are both 
equal to Werd, and apply (i). This completes the proof. 

We note that, in this lemma, the assumption that n is even is essential. 
In fact, otherwise all three statements are false. Now we turn our attention 
to T,(2) and construct a set of generators. 

I i, j are distinct positive integers at most equal to g, we replace the 
(4,7)-coefficient in 1, by 2. We take this matrix as a and put b == c =Q, l 
d=a tat, The corresponding matrix Ay is then an element of T,(?). If+ is 
a positive integer at most equal to g, we replace the (i,t)-coeflicient in 1, 
by —1. We take this matrix as a and put b= c == 0, d==ta. The corres- 
ponding matrix Ay is an element of T,(2). I£ +, j are integers satisfying 
1St<jSg, we replace the (i,5)- and (j,+)-coefficients in 0 by 2. We 
take this matrix as b and put a == d = 1, c==0. The corresponding matrix 
By is then an element of T,(2). If+ is a positive integer at most equal to g, 
we replace the (t,1)-coefficient in 0 by 2. We take this matrix as b and put 
a=d=1, c=0. The corresponding matrix By is an element of T,(2). 
Finally we put Cy=='By for +<j. We shall prove the following theorem: 


THEOREM 1. The g(2g+1) matrices Ay (1St,jSg), By, Cy 
(1SiSj=Sg) form a set of generators of T,(R). 


Proof. Suppose that M is a given element of T,(2). Since the diagonal 
coefficients of M are odd while other coefficients of Af are even, they are 
different even in absolute values. This being remarked, we multiply suitable 
powers of Ais, - +; Ai, Bin‘ ` +, Bu: in this order from the right to M and 
make the coefficients u,‘ © >, Gug; b115 © *, Dig less than abs.a,, in absolute 
values. In case they are not all zero, suppose that a, or possibly b,; is the 
first coefficient in the sequence which is different from zero. Then multiplying ~ 
a power of A, or Cı; from the right according to the case, we make a less 
than abs.a, or abs.b,, in absolute value. Applying these two operations 
“alternatively, we make ts * *,@ig,b11,°° "di, all zero. Then we get 
41:44, = 1, hence by multiplying A,, if necessary, we get 0, = du == 1. This 
being done, we multiply suitable powers of Aa,- © +, Agi, Cis," + +; Cag in this 
order from the left and (without changing the first line) make az, - -, ag 
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City" © ‘Cg, all zero. In this way M is expressed as a product of powers of 
the Ay, By, Cy (more precisely of Ais Au, Bi, Cu) and the following matrix 


1 0 0 0 

0 a b b 
0¢ 1 g 
0 ud & 


Since M* is in T,(1) (in fact in T,(2)), we have 


M* = 


b” = 0, @tbi = btt 
cd = de, dtd = dte, tdh = diti 
d” = 0, mt = bt, ay'd, — dite, lg. 


Since *M* is of the same form as M* and is in T,(1), we have not only 
b” == d’—0 but also c’ == d’==0. Moreover 


is in T,1(1), in fact in T,.(2). We have only to observe, finally, that our 
set of matrices is such that we can apply an induction on the degree. This 
completes the proof. 

We note that, since for any prime factor p of n, the factor group 
T,(n)/T,(np) is commutative and indeed a vector space over Z/pZ of 
dimension g(2g 4-1), no T,(n) for n > 1 is generated by less than g(2g +1) 
` elements. In particular, none of the generators of T,(2) in Theorem 1 is 
redundant. At any rate, Theorem 1 implies that, if M is an arbitrary element 
of T,(2), it can be written in the form 


M= JT Ags II Bau TI Oyu W 
ISi IH 1 


with py, qu, Ty in Z and M’ in the commutator group of T,(2), which are by 
no means unique. We shall denote the gX g integer matrix (py) by p. 
Similarly we shall use g, r to denote the symmetric matrices defined by qy, 
ry. Using this notation, we shall prove the following statement: 


SUPPLEMENT. Suppose that an element 
a b 
tala) 
of T,(2) is expressed as a product of powers of Ay, By, Cy with exponents 
given by p, q, r and of an element of the commutator group of T,(2). Then 
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M is in T (2,4), T,(4) or in T,(4,8) if and only tf (q) == (r)o==0 mod 2, 
p,,r=0mod2 or (q)o= (r)os=0 mod 4, p,g, r= 0 mod 2. 


Proof. We observe that the said product of powers of Ay, By, Cy is con- 
gruent to the following matrix 


modulo the greatest common divisor of the coefficients of 4p, 4q, 4r. We 
recall also that W’ is contained in T',(4,8) by Lemma 1, (ii). The supple- 
ment follows immediately from these two facts. 


2. Transformation law of theta-functions. The definition of theta- 
functions was already recalled in the introduction. We shall review some 
elementary properties of the theta-functions with brief indications of proofs 
Lef. 7, 8]. First of all, as an analytic function of z, the theta-function Om (7, 2) 
is characterized up to a constant factor by the functional equation 


Om(7,2-+ (riojn) = elm,n)e(— nz — $: *n’rn’) Om (7, 2) 
satisfied for every n in Z% where . 
e(m, n) = (1) in 


and e( ) stands, as usual, for exp (27i ). In fact, the theta-function satisfies 
the functional equation. Conversely, if 0(z) satisfies the functional equation, 
we see that e(—4-'m’z)6(z) is invariant under z—> z- n”. Expanding this ` 
periodic function into a Fourier series, we use the functional equation for 
n” ==, and we get 0(z) =const. 6m(7,2). We next observe that, as an 
analytic function of r and z, the theta-function is characterized up to a 
constant factor by the functional equation and by the heat equation 


8° On / 82 fen = Sart Imn / 0 
5937, m/z g yi Om/ Or, 


satisfied for any complex coefficients yj == yz These being remarked, let A 
be a complex non-singular matrix and p a complex symmetric matrix both 
of degree g. Also let 0,(7’,z) be a theta-function of characteristic n. Then 
we have a relation of the form 


15 
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On(7’, 2) = K- e(h: tap) Om(7,2) (KE = const.) 


as functions of 7 ==Az if and only if there exists an element M of T,(1) 
(composed of a, b, c, d) such that 


A==F(er-+d)4, p= (ert+d) te 
= M:r, n=M m mod 2, 


where M:r was defined in the introduction and M-m has the following 
meaning 
d —c ee 
un, tl) 


In fact, under these conditions we can verify easily that e(# *zuz) On (r, 2) 
satisfies the same functional equation as 91(7’,z’), hence they differ only by a 
constant factor. The proof of the necessity of the condition is more involved. 
We have to use the “primitivity” of the period group generated by the 2g 
column vectors of (r1,) for e(4-*zuz)Om(r, 2). 

Concerning > M:r and m—> Mm, we observe that they are defined for 
M in Sp(g,R) and m in R”, and we have 1,,‘r=r, log'm—=m. Moreover, 
if M,, M, are in Sp(g,R), we have Mi: (Ma'r) =M,M,-7 and if they are 
in Sp(g,Z), we have 
i M- (M-m) =M,M;:m mod2. 


In particular T,(1) operates on the additive group of characteristics mod 2, 
which is (Z/2Z)*?, just as Sp(g,R) operates on ©. However, one is transi- 
tive and the other is not. In fact, if we put , 


e(m) = (—1) 1m" 


for any characteristic m, we have e(M-m) —=e(m) for every M in T,(1). We 
know, however, that T,(1) operates transitively on each set of characteristics 
mod 2 classified by e(m) =-+1. These characteristics are called even or odd 
because we have 


Om(7,— 2) = 6 (tt) Om (7, 2). 


At any rate, the transitivity can be proved, for instance, by an induction on 
the degree. Now, if m is odd, clearly the theta-constant Ay(r) = Om(r, 0) 
vanishes identically as a function of 7. On the other hand, if m is even, it 
does not vanish identically. Since we have Ou-m(M-r) —K6m(r) and since 
K is different from zero, we have only to show that 4,(r) does not vanish 
identically. But this is a consequence of 
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lim fy (inl) = 1. 
pe» 


These being remarked, we shall try to determine the constant K as 
explieitly as possible. At any rate K is a non-vanishing analytie function in 
©,. Moreover, using the heat equation and the following relation 


Br’ =m (or + d)-*(8r) (cr +d) 
between differentials, we can derive the differential equation 
Dd ysðlogK/ðrm=}: D Yan 
ISIS ISJ kg 


whenever the characteristie m is even. On the other hand, the formal 
identity 8(log(det X)) =trace(X-18X) applied to X =cr-+d, shows that 
det(cr-+ d)# satisfies the same differential equation as K. In this way, 
we get 

K = const. det (cer + d)i, . 


Observe that the square root is not unique but it is a well-defined non- 
vanishing analytic function in &,. The constant we have now does no longer 
depend on r. 

We shall separate the part of the constant which dependa on m. We 
observe that we have 


Om(r,2-+ $° (rlo)n) = e (— 1/8: n'n 
— pw (e+ (m” + 0”))) Omen (1, 2) 
for any n in Z?°. Also, for a given M, if we choose the sign of the square 
root det(cr-+-d)#, we have 


Our-o (0,2) =æ(M) det (or + d)te (4: tape) O9(r, 2) 


in which 2(M) depends only on M. We replace z by z -+ $: (r1,)m and make 
a little calculation. Then we get the following transformation law of theta- 
functions 


Ou-m(M-7,* (er + d)72) =2(M)e(öm(M))det(cr + d)? 
-e(4- *z(cr + d)-*cz) Om (7, 2) 
in particular 
Oar-m (Hf -7) = 2(M) e(¢m(M) ) det (er + d)#6n (7). 
with 
dm(M) = —4- (mbam + !m”tacm” — 2!m’!bem” 
— 2 (atb), (dm .— cm”)). 
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The constant z(M) has been explicitly calculated when the left bottom sub- 
matrix c is non-singular [?, pp. 180-2]. Also, using some of Siegel’s calcu- 
lations [10], we can obtain an explicit (but complicated) finite form for 
æ(M) in general. In the next section, we shall proceed differently and 
determine æ( M)? explicitly for every M in T,(2). 


8. Theta-constants as modular forms. We know that T,(2) is gen- 
erated by g(2g +1) matrices Ay, By, Cy. We shall calculate the constant æ 
for these generators of T,(2). In order to increase the readability, we shall 
arrange the material so that it is self-contained. We shall start proving the 
following classical lemma: 


Lexma 2. If w is a point of the upper-half plane and if the square 
root (—iw) ts the one which is positive when w is pure imaginary, we have 


BAU (—1/w) p*) = wi eh wp?) 


Proof. I£ we apply the transformation law of theta-functions to the case 
g=1, M =E (in Section 1), we see that the two sides differ at most by a 
constant factor. By specializing w to i, we see that the constant is one. 
This proves the lemma. 

In the formula just proved, we replace w by #—2 and the new w by 
—1/w. Then we get the following formula 


P ae. 1) +p) = (20 + Di Bed up), 


in which (2w + 1)# is in the first quadrant. We shall obtain one more formula. 
We apply the transformation law of theta-functions to the case g = 2, M = E. 
Then we get 


got (1/2 (Tııra2 Ei (r12)?) . (— T22 (p1) 2 — Til (p2) A + ArısPıP3) ) 
= const. ( (t1x)*—rantas)! 2004 ` (tu (pi)? 
+ Ta (p:)° + Arı2PıPa) ) 


in which ((r1)?— rı1r32)% is positive when r1, rs: are pure imaginary and 
tia is real. We put rn = Ta: == W, T12 —0 in this formula and compare that 
with the square of the one in Lemma 2. In this way, we see that the constant 
is one. We then replace rı,, 723 by wi, W3 and tiz by —-2, where w,, w: are 
points of the upper-half plane. In the formula so obtained, we replace w,, wg 
by — 1/wı, —1/w,. Then, using Lemma 2 again, we get 
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aa eA ww) ` (w: (p1)? + wa (pe)? — 4ww:pıpa) ) 
— (1 —4wws)i Belt - (w: (pi)? + w:(p2)°)); 


in which (1—4w,w,)4 is positive when w,, w: are pure imaginary. This is 
the formula we have liked to obtain. 

Now, in the following, we agree to take (plus) one for det(cr+ d)? 
when the determinant is the constant one. Also, in determining the constant 
æ, we shall use diagonal matrices for r. We apply the transformation law of 
theta-functions to M == A; for +547. In the formula so obtained, we make 
all zx, except for k==4,j tend to infinity along the imaginary axis. Then, 
if we replace zy, ry by w:, Wz, we get the following formula 


= 04 > ((wı + 42) (p1)? + we (po)? + 4eop:p2) ) 
= =(Au) D, ' (w (pi)? + w2(p2)*)). 


Since the binary quadratic form in the exponential on the left side is 
w: (p1)? +- Ww (2p1ı + pa)’, we see that the two infinite series, which are nothing 
else than 6)(,)9(w2) with 6, for g=1, cancel each other. Therefore we 
have 2(A,;) 1. In more or less the same way, we can determine 2(Ax) 
and z(By). If we take det(cr + d)? =e(4) for M = Ay, we have 2(Au) 
«= 6(—4) so that their product is one. Also we have #(By) =1 including 
the case +== 7. For the calculation of x(Cy), we made preparations already. 
In fact, if we follow the same method, we get 


m ee (1/2 (1 — 4,02) - (ws (pi)? + w2(p2)? — 4wıW3P1P3) ) 
= 2(Cy) Anm) 208 (ws (pi)? + w2(pe)?)) 


for i<j. Therefore, if det(cr + d)# is positive when r is a pure imaginary 
diagonal matrix, we have æ(Cy)==1. Similarly, we have #2(Cy) —1 if 
det (cr + d)4 is in the first quadrant when r is a diagonal matrix. We shall 
summarize our results in the following way: 


TEEORRM 2. With the choice of the square root det(cr 4 d} as explained, 
we have 
æ(Ay)=1 (1j), #(Au) =e(—ł) 
æ(By) =2#(Cy) =1 (Sj). 


This theorem allows us to obtain æ(M) for any given M in T,(2). 
We shall introduce a notation. Tf n is an integer, we shall denote by (—4/n) 
the (value at n of the) Kronecker symbol for the prime discriminant — 4. 
This means simply that (—4/n) is 0 or +1 according as n is even or 
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+1mod4. Now, if M is an element of T,(2) composed of a, b, c, d, we put 
(—4/M) = I (—4/dy). 
pes De 


We note that the product can be restricted to diagonal coefficients. Also we 
can as well take the product over the coefficients of a. The point is that 
M-> (—4/M) is a character of T,(2) in the sense 


(—4/MM") = (—4/M) (—4/M’) 


for M, M’ in T,(2). Note also that we have (— 4/— M) = (—1)9(—4/M). 
Now we shall consider products of theta-constants. Let m, n be two even 
characteristics and put y = fmn. We shall show that there exists a character 


x of T,(2) satisfying 
y (Mr) = (—4/Il)x (I) det (or + d)y(r) 


for every Min T,(2). Since we have M-m==mmod2 for every M in T,(2), 
the transformation law of theta-functions shows that we have such a relation 
with some constant x(M), and clearly x(—M)==x(M). On the other hand, 
if M and W are arbitrary elements of Sp(g,R) composed of a, b, c, d and 
a’, b’, d, d respectively and if MM’ is composed of a”, b”, c”, d’, we have 
Or dm (cr +d) (er+d’) in which 7’ =M’-r. The verification is 
straightforward. Therefore, by taking M and W’ from I,(2), we get 


x( MAL’) NK). 


This shows that x is a character of T,(2)/+ 1s. Now, using Theorem 2 we 
shall determine x(M) for M = Ay, By, Cy. 

Since the computations are similar, we shall illustrate them in the case 
MH = By. We note first that the solution of My m differs from m only in 
its (g-+%)-th coefficient, and this is mj”+2(m/—1). Hence 6,(r) and 
Im(r) differ by (—1)™(™') —1. Similarly we have 6,(7)=@n(7) for 
M-)y==n. Therefore, by the transformation law of theta-functions and by 
Theorem 2, we get 


(M:r) = fu- (M r) (Mr) 
— e(&,(M) + (H) ) det (or + a)y (r) 
= 6(— 4 ((mi’)? + (ni)? — më — 2m’) ) 
-det(er + d)y(r). 


Since we have (—4/M) == 1, this has to be x(M)det(or-H-d)y(r). In this 
way, we get 
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x Bu) = (— 1) mm'e(— 4 (m)? + RP). 
The computations of other x(M) are similar, and we have 
x(Ay) = (1) inten” 
x(By) = Deren (<9) 
x) een (i<j) 
x(Cu) =6(— (+). 
We shall formulate our results in the following way: 


THEOREM 3. Suppose that an element M of T,(2) is expressed as a 
product of powers of Ay, By, Cy with exponents given by p, q, r and of an 
element of the commutator group of T,(2). Then p=OmOy satisfies the 
functional equation 


w(M +r) = (—4/M)x (M) det (er + d)y(r) 
in which 
(AU) (Um,  x(M) = (—1)4e(— 
with 
A ge 7 n Ian : m ’m , In, 7 & 
BR. + nn; + 2, l im + n/n’) ; 
+ 2. rym m’ + i n) 
1St<jSg 
B= D ql (mi)? HR) + LH). 
Ist ISS 
In particular, if M is contained in the congruence group T, (4,8), we have 
(—4/M) =1 and A=0mod?, B=Omod4. Hence we have y(il-7r) 
= det(cr-+d)y(r) for every M in T,(4,8). Also, in the case g=1, the 
necessary condition at infinity is satisfied for y == Ondn. Therefore each Inn 
is a modular form of weight 1 belonging to T,(4,8), i.e. it is an element of 
A(T,(48)):- 


4. Vanishing of theta constants. We shall first recall some further 
properties of theta-functions (with brief indications of proofs) [cf. 2, 7, 8]. 
In general, suppose that @ is a topological abelian group. Then a lattice 
in G@ is a discrete subgroup of G with compact factor group. Let A, and A, 
be two lattices in G which are commensurable (in the usual sense, i.e. their 
intersection has finite indices in both of them). Then A == A, -+ Ag is also a 
lattice in G. Suppose that f is a complex-valued function defined on G (or 
‘at least on A) for which $ f(n) is absolutely convergent when n runs over A. 
Then the summations of f over A, and A, are related as follows: 
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Lemma 3. We have 
=f (m) —=1/[A: Ai] 2 (Zx(matr)f(n+r)), 


in which ni, na run over Ay, A, while x and r run over the dual of A/A, and 
over A/Ag. 


In fact, the lemma hardly needs any proof and it simply depends on the 
orthogonality of characters of finite abelian groups. However, it has a 
number of applications. Take, for instance, the group of four vectors in R° 
as G and its subgroup of integer vectors as A; We consider elements of A; 
as g X 4 matrices and multiply the following orthogonal symmetric matrix? 


1 1 1 1 


ase 1 1 —1 —1 
1 —1 1-1 
i —1 —1 1 


to them from the right. Take the lattice of such elements as Aj, i.e. put 
A= A,A. Then A, and A, permute by right multiplication of A and their 
index in A is 2°. We shall use (p 0 0 0) where the coefficients of p are 0, 1 
as representatives of AmodA,. As for the function f, let m, a, b be three 
tharacteristics and put m, =m, m= m+ a, m =m +b, m—m—a—b. 
Further let + be a point of ©, and th, Us, Us, U, four points of C°. Put 


Fa) = IL 6E (Ta + ma’/2)r (zu + ma'/2) 
+ (Ta + Mo’/R) (Ua + Mma” /2)). 


We then apply Lemma 3 to these data and make a straightforward calculation. 
In this way we get 


Oin (T, Ua) Oma (T, Ua) Omin (T, Us) Omas (7, ta) 
=o 1/29 i i 2,0 (m, n) On (7, V1) Ona (7, DIALER, (7, Us) On-a-H (T, v,) 
mo 


in which (u, ts: us u,) and (vı Va Vs V4) are related by right multiplications 
of A. We observe that A is nothing else than the case g=1 of the 227 x 2% 
cofficient matrix (1/29-e(m,n)), which is orthogonal symmetric (and proper 
for g& 2). At any rate, the above formula is known as “Riemann’s theta- 
formula” while its full meaning was known to Jacobi in the case g—1. 


"We note that any improper orthogonal symmetric matrix A* (of degree four) 
-such that 2A* but not A* itself has integer coefficients can be transformed into + A by 
an integer orthogonal matrix. 
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We make another application of Lemma 3 which we shall use in this 
section. We take the group of two vectors in RP as @ and its subgroup of 
integer vectors as A, This time we multiply the following matrix 


1 1 
aR G a) 
to A, from the right to define A,. Then we have A = A, and the index of A; 
in A is 29. As for the function f, let mı, Ma be two characteristics with 
m)’ = M” = m” and put 
f(2) — IL (° (te + ma’ /2)+ (2a + ma'/2) 
+! (zu + ma! /2) (Zua + m”/2)). 
We then apply Lemma 3 to these data and immediately get 
8 (my) (2r, 2u,)0 (78) (2r, Vite) = 
1/2: > (1) mem’) (r,t, + te) (re) (r, Ut — Wr). 
n mod 3 


We multiply (—-1)'™'” to both sides and take a summation over m,’ mod 2. 
In this way we can solve the system of equations and we get 


O (mier) (T> Ua F ta) O (7) (T, U1 — Ua) 
= 3 (—1)'™ 6 (m) (2r, 2u,)0 (Pi) (2r, Zua). 


my’ mod 3 
If we put my == my’, ug==0 in the first formula and m”=0, u, == u, in the 
second formula, changing the notation slightly, we have 


Om (7) Om (7, 22) = 1/29 lin (— yes? 


O (wen) (7/2, 2)0 (9) (7/2, 2) 
Im 2 DR) A) (278). 


We call them the first and the second (principal) transformations of degree 
two. 


Now we shall start using these formulas. We shall prove the following 
lemma: 


Lemma 4. Suppose that r is any given point of Sr Then at least 
one theta-constant does not vanish at r. 


Proof. If the statement is not true, we have 6,(7) 0 for all m at 
some point r of G,. We can then derive a contradiction using either one of 
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the transformations of degree two. For instance, the second transformation 
implies 
E (-1)'""*9(%) (27,2)? = 0 
n’mod2 , 


for all m”. By solving this system of 27 equations, we get 
6 (%) (27,2) = 0. 


But no theta-function vanishes identically in z (no matter what r or in this 
case 2r is). This proves the lemma. 

We shall see later that Lemma 4 has an important consequence. It is 
rather surprising that its clear statement does not exist in any well-known 
literature we came across. We shall add further comments to Lemma 4. 

In general, we consider a subgroup g of the additive group of charac- 
teristics mod 2 such that e(m,n) = 1 for all m, n in g. Any maximal sub- 
group with this property is called a Göpel group. Clearly the group of 
characteristics mod2 satisfying m’==Omod2 or m’==0 mod? is a Göpel 
group and Göpel groups are of order 2%. Also, if g is a Göpel group, it has 
29 cosets and they are called Göpel systems modg. Now the finite group 
Sp(g,Z/2Z) =T,(1)/T,(2) is precisely the orthogonal group in the vector 
space of characteristics mod2 with respect to the quadratic form e(m,n) 
¢when the multiplication of elements of Sp(g,Z/2Z) and vectors is an 
ordinary matrix multiplication). Therefore, it Sp(g,Z/2Z) operates on the 
vector space as m— M-mmod 2, Göpel systems are mapped to Göpel systems. 
Moreover the stabilizer of the Göpel group defined by m”==0mod2 is the 
subgroup of Sp(g,Z/2Z) defined by b=0mod?. Since the order of this 
subgroup is equal to the number of symmetric matrices mod2 of degree g 
multiplied by the order of SL(g,2/2Z), its index in Sp(g,Z/2Z) is 
(29+ 1) (277+4-1)---(2+1). Since this is clearly the total number of 
Göpel groups, there exist as many Göpel systems consisting of even charac- 
teristics. On the other hand, if a Göpel group g is given, there exists one 
and only one Göpel system mod g which consists of same kind of characteristics. 
In fact, because of 


e(m+ n) = e(m)e(n)e(m,n), 


the function m—e(m) is a character of g. However any character of g can 
be written in the form e(m,a) with some characteristic a uniquely deter- 
mined modg. Then the Göpel system g + a consists of characteristics of the 
same kind while other Göpel systems mod’g are mixed. Therefore, we see that 
the Göpel system g-+ a consists of even characteristics and the total number 
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of even characteristics is 2¢7(29-++1) while the total number of odd charac- 
teristics is 277 (2 —1). Furthermore Sp(g,Z/2Z) operates transitively on 
the set of Göpel systems consisting of even characteristics. 

Now, suppose that g is an arbitrary Göpel system. Then, for any given 
point r of Gj, we shall denote by n,(r) the number of linearly independent 
functions (in z of course) among Om(r,z)On(7,2) over C with m, n in g. 
Then, of we increase z by $> (ri,)a, we see that nga(r) = g(r) for every a. 
Also the transformation law of theta-functions implies 


nau-g( MH: 1) = ng(7) 


for every M in T,(1). Therefore we will know n,(r) in general if we know 
it for any one of the Göpel systems. We take the Göpel group defined by 
m’=0mod?2 as g. Then we have the following remarkable relation 


ng (T) = number of non-vanishing ba(2r) for all a. 


We first observe that the 2% theta-functions 6,(7,z) are linearly independent 
over C for any given r. Otherwise, suppose that there exists a linear relation 
between a(r,2) with complex coefficients ca say. Increase z by (r1,)n and 
use the functional equation. Then we get cp fa(7,z) = O,hence Ca = 0 for all a. 
Now the first transformation of degree two shows that the (complex) vector 
space of functions generated (as linear combinations) by 69 (2r)6q(2r, 22) 
coincides with the vector space of functions generated by Om (T, 2)On(r, z) with 
-m ==’ = 0 mod2.° Accordingly, we can compute the dimension of the vector 
space in two ways and we get the said relation. We note that this was at 
the basis of the proof of Lemma 4. As an extremely special case, we see that, 
in the case g==1, none of the three theta-constants Ha (W), Oo1(w), 610(w) 
vanishes at any point w in the upper-half plane. This fact will be used in 
the next section. 


5. Field of modular functions. In general, if T is a discrete subgroup 
of Sp(g,R) commensurable with T,(1), we shall denote by F(T) the field 
of homogeneous elements of degree zero in the field of fractions of A(T) 
and call it the field of modular functions belonging to T. This is an algebraic 
function field of dimension $-g(g-+1) over C. The purpose of this section 
is to prove the following theorem: 


THEOREM 4. The field generated over C by quotients of theta-constants 
contains F(T,(1)) as tts subfield. 


The proof of this important theorem consists of several steps most of 
which are due to Wirtinger [12]. However, since certain arguments (see 
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e. g., p. 29) are not too convincing, we shall make some modifications. Suppose 
that r is a point of ©, z a point of C2 and k a non-negative integer. Then 
an analytic function @(z) of 2 satisfying the functional equation 


@(z+ (In) em n)e(—k(*n’s + 'nrm))®(z) 


for every n in 2% is called a theta-function of order k and of characteristic m. 
The set of such functions forms a complex vector space and, by using Fourier 
expansions of e(—4-'m’z)@(z) as in the case k==1, we can show that its 
dimension is equal to k’. We shall denote by S+» the vector space of theta- 
functions of order 4% and of characteristic zero, and consider the graded ring 


S= OD & 
he ae 


over o= C. Clearly 6,(7,22) are elements of 8, (as functions of 2) and 
they are linearly independent. Therefore the 27 theta-functions Om(r, 22) 
form a base of Sı. We shall show that they generate S at least when r is 
contained in some “admissible set” by which we understand the complement 
of a countable union of closed analytic subsets of ©, having empty inter- 
sections with the set of diagonal matrices. 

We have only to show that among all %-fold products of Om(r, 22) there 
exist (4%)9 linearly independent ones. For this purpose, we can replace 24 
by z. Since the linear independence can be determined by the rank of the 
(infinite) coefficient matrix of their Fourier expansions, we have only to 
construct (4%) products of #m(r,2z) which are linearly independent when r 
is a diagonal matrix. We say that a k-fold product of Om(r,z) for the 
characteristics 11,,- © +, mw is canonical if, in the 2g X k matrix (m,.- © ms), 
the 2X k submatrix composed of i-th and (g-+i)-th lines is one of the 
following four types 


Ho Ho 


ATN 
oo . . 
oo CO 


11 

0 a 

for +—=1,:-+-,g. The number of canonical products is clearly (4k)s. On 
the other hand, the following 4% products of elliptic theta-functions 


boo (w, 2) Bo: (w, z)% p+g=k 
Boo (10, 2) "Bor (W, 2) B10 (W, 2) p+g=k—1 
(1,2) (10s £) 8,5 (1,2) ae 


600 (W, 2) ?Oox (W, Z) ro (W, 2) O11 (w, 2) p+q~k—2 
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are linearly independent for every w in the upper-half plane. In fact boo (w, 2), 
0.1(%,2), O19(, 2) are even while 6,,(w,2) is odd. Moreover 6oo(w,2) and 
fa (w,2) are invariant while 6,,(w,z) changes its sign by z->z-++1. There- 
fore we have only to show that the first k+ 1 products are linearly indepen- 
dent. But this is a consequence of the fact that 6.(w,z) and @,(w,2) are 
linearly independent. Therefore the (4%)? canonical products are linearly 
independent when 7 is a diagonal matrix. This proves the assertion. 
As a consequence, if 7 is in the admissible set, we have 


On (t, 2) * Om (7,2) = x Amo Om (7, 2) * + * Om, (7, 2) 


with uniquely determined coefficients Am-m, for every ti," ‘ne The 
summation is extended over the (4%)? canonical products. We shall investi- 
gate the coefficients in the case k=—=2. Let 6y,(r,2)9,(7,2) be an arbitrary 
product. Then there exist 27 canonical products 6m,(7,2)6m,(7,2) satisfying 
mu +m=n+nmod? and On,(7,%)6n,(7,2) is a linear combination of 
them. If we replace z in this relation by $- (rl,)n, we get 


Oran (t) Ongen (7) = È Amme ($: nN (n + n: — m,” — my’) ) 
"Omen (T) Omen (7). 


We shall show that the 2° x 220 matrix (+ Omun(rT)@man(7)) has rank 29 
when r is a diagonal matrix, hence when r is contained in some admissible 
set. If r is a diagonal matrix, the problem is reduced immediately to the 
case g= 1. In this case the matrix in question has rank two because none 
of the three even theta-constants vanishes at any point of the upper-half plane. 
Because of this, the Amm, can be determined by solving the above system of 
linear equations. Hence they are contained in the field generated over Q by 
Om, (7) On (7) /Om,(7)Ong(7) where the four characteristics are even and satisfy 
m -+ nm == M: +n:,mod?2. It is assumed, thereby, that r is in some admis- 
sible set. 

Now pick a point ro of ©, which is a diagonal matrix with diagonal 
coefficients #,,-- -,w,. Also we shall denote by r= (ry) a variable matrix. 
Then the set of convergent power-series in r; for 1-47 and u— ur forms a 
regular local ring R. The previous argument shows that the Am-m, are 
contained in R. We associate a letter Xm to each characteristic m with coeffi- 
cients 0, 1 and consider the ring of polynomials R[X] in the set X of 2% 
letters Xm with coefficients in R. Also certain monomials in Xm are called 
canonical in an obvious way. We shall denote the field of fractions of R by F. 
If f =f (7) is an element of R, the correspondence f > f(r) gives the canonical 


233 - JUN-ICHI IGUSA. 


homomorphism of R to its residue field C. Moreover, if we replace X; by 
. Im(r,2), we get a homomorphism from R[X] to the ring of polynomials in’ 
§m(r, z) with coefficients in R. We shall denote its kernel by J. Then T'is a 
homogeneous ideal of R[X] and the homogeneous ideal J of R[X] genersted 
by l 
Xunn — 5 Amım, X, sre. 
canonical 

_is contained in I. Our purpose is to prove F[X]J -== F[X]I. We shall first 
show that the image of J under the canonical homomorphism R[X] > C[X), 
which we shall denote by C[X]J, coincides with the kernel of the homo- 
morphism from C[X] to the ring of polynomials in ĝm(ro, 2) with coefficients 
in C (defined by the substitution of Xm by Om(70,2)). We observe that in 
the elliptic case there exist two non-canonical products and they are 615 (w, 2)? 
and 6,,(w,z)?, Furthermore they are linear combinations of 0o)9(w,2)? and 
601(w, 2)”. Suppose that P (w, z) == Q(w, z) is either one of these two relations 
and replace (w,z) by (w,%) for any i satisfying 1Si<g. Choose g—1 
canonical products out of eight and replace (w,2) by (ws, 21), © +, (Wea, 2-1), 
(Wir, Zur), °°, (Wo 2g), and multiply to P (w, z) = Q (wz). In this way 
we get a relation of the form 


-Om (Tos 2) Ona (To, 2) = nie Amme ‘Om, (To, 2) Om, (To, 2) 


with Amm, in C. Because of the linear independence of the canonical products, 
if Amm, = Amm (r) correspond to fm (r, 2)On.(r, 2), we have Amm — Anm): 
Hence 
And — 2, Amm, Enn 
canonical 


is contained in C[X]J. We observe that Amm do not change even if we 
permute j-th and (g -+ j)-th coefficients of n, with those of ns for j = 1,2,: + +, g.. 
Therefore, if nı, ng become ty’, ns’ by this permutation, then 


Xx, na na 7 X ng Ts, 


is also contained in C[X]J. It is then clear that any homogeneous polynomial 
in C[X] is congruent to a linear combination of the canonical products of 
the same degree mod C[X]J. Therefore, if the polynomial vanishes by the 
substitution Km On (70,2), it is contained in C[X]J, and this is what we 
wanted to prove. We shall now recall the following simple lemma: 


Lemma 5. Let R be an integral domain, F its field of fractions and 
C the field of fractions of a residue ring of R modulo one of its prime ideals. 


coe 
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Let X be a finite set of letters and J a homogenéous ideal of RX]. Then 
we have 


| dim (CLX]/CLX]J)x = dime (F[X]/F[X]J)x 
in which the subscript k indicates the homogeneous parts of degree k. 
Proof. We have only to prove 
dimo (C[X]J), = dime (F[X]J) x. 


Suppose that p.(X),-- -,p.(X) form a base of (C[X]J), over O. We can 
assume that they are images of P;(X),- -© -,P,(X) in J; under the canonical 
homomorphism R[X]->C[X]. We arrange monomials in X of degree k in 
a sequence as Y,,-- +, Yy and write 


P(X) = rni 1StSn 


with cy in R. Let yy be the images of cy under the canonical homomorphism 
R->C. Then we have rank(yy) =n, hence rank(cy) =n. Consequently 
P,(X),: - -,P„(X) are linearly independent over F. This proves the lemma. 
~ I£ we apply this lemma to the present case (with C == C), observing 


dime (C[X]/C[X]J), — dimp (F[X]/F[X JI) = (4h)? 


and the fact that J is contained in I, we get (F[X]I),.—= (F[X]J). for 
k=0,1,: +. Since F[X]I and F[X]J are homogeneous ideals, this implies 
FIX — FLX. 

Going back to the notation where r means a point of ©, we see that 
the mapping z— (Am(r,2z)) defines an analytic isomorphism of the complex 
torus T=C7/(71,)2% to an abelian variety in a complex projective space of 
dimension 2771, which is nothing else than the projective variety associated 
with the graded ring 8. Furthermore, the defining ideal of this projective 
variety has a basis consisting of homogeneous polynomials of degree two with 
coefficients in Q (Om,(7) On, (7) /Om,(7) Ong(r)) where the characteristics are even 
and satisfy m, + tı == Me + n,mod2. It is assumed that r is in some admis- 
sible set. Therefore Q(6m,0n,/OmOn,) is a field of definition in the sense of 
Weil [11] of a generic abelian variety of the family and it contains the 
“field of moduli.” It is known [ef. 1-20] that, if we extend the constant 
field from @ to C, the field of moduli becomes F(T,(1)). Therefore 
C(OnOn,/Omn,) contains F(T,(1)). This completes the proof of Theorem 4. 


6. Fundamental theorem. We shall combine the preceding results to 
obtain the “fundamental lemma” stated in the introduction. We first make 
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some simple observations. Suppose that U is a complex manifold on which 
a group @ operates as a group of analytic automorphisms. A non-vanishing 
analytic function R defined on U and depending on M in @ is called a factor 
of automorphy (for G) if it satisfies R(M,M,„,r)=R(M,Ms r)R(M,,r) 
for al M,, M: in G. If M is an arbitrary element of G and f an analytic 
function in U, clearly 


(M-F) (7) = RCM, 1) f (M>) 
is an analytic function in U, and we have 
My: (Ma f) = (M.M) f, identity f—f. 


Therefore G operates on the ring of analytic functions in U. Now suppose 
that T is a (discrete) subgroup of G. Then an analytic function f in U is 
called T-automorphie (for #) if it satisfies M -f =f for all Min I. We see 
immediately that, if f is T-automorphie, then M-f is MTM-'-automorphic. 
There are two special cases which are of some importance. Suppose that T 
is contained in another subgroup T* of G as a normal subgroup. Then T* 
operates on the complex vector space of T-automorphic forms as above (and 
invariant elements are precisely I'*-automorphic forms). Another case is 
the following. Suppose that U is the Siegel upper-half plane ©, and T an 
element of Sp(g,R) such that miT has integer coefficients for some positive 
integer m. Then TT,(n)T"! contains T,(mn). Hence, if f is T,(n)-auto- . 
morphic, then T-f is T,(mn)-automorphic. Also, in the case m =?2 and n 
even, we see that 7T,(n, 2n) T> contains T,(?n,4n). Hence, if fisT,(n, 2n)- 
automorphic, then T-f is T,(2n, 4n)-automorphic. 
Now, if M is an element of Sp(g,R) composed of a, b, c, d, then 


R(M, 1) = det (or + d)* 


defines a factor of automorphy for any integer k. Moreover, if T is a sub- 
group of Sp(g,R) commensurable with T,(1), modular forms of weight k 
belonging to T are (except for a modification in the case g = 1) precisely T- 
automorphic forms for this R. Therefore the general consideration can be 
applied to our case. In this way, for instance, if T is a normal subgroup: of 
T,(1), the finite group T,(1)/T operates on the graded ring A(T) and we 
can try to decompose each homogeneous component of A(T) into irreducible 
stable subspaces or, at least, determine the character as Hecke (and his 
student) did in the case g==1 for r =T;(q), q a prime number. However, 
in order to be able to do this, we have to have sufficient informations about the 
ving A(T) (and about the group T,(1)/T). For the congruence group 
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T,(4,8) (defined by M=1,,mod4, (b),= (c)o==0 mod 8), the following 
theorem is fundamental: : : 


THEOREM 5. The ring A(T,(4,8)) of modular forms ls to 
T,(4, 8) is the normalization of C[6mOn] in its field of fracttons.. 
We need the following lemma: 


Leama 6. Let yi,-- +, Wn be modular forms belonging to T with no 
common zero in the quotient variety T\S, and its boundary. Then the ring 
A(T) is integral over C[s,- ` +, Yn]. 


In fact, the theorem of compactifications reduces the problem to a purely 
algebraic statement. This algebraic statement is a consequence of Hilbert’s 
“Nullstellensatz.” Since Hilbert’s original treatment is simple and elegant, 
we refer the proof to his paper [3]. 

We shall apply the lemma in the following way. Let m’ be an even 
characteristic for genus g—1 and add two more coefficients m,’==0, my” 
== arbitrary to get an even characteristic m (for genus g). Then, for every 
point 7’ of Sp we have 


(P Bm) (°) — im Om G 3) ee 


Consequently, the “ Siegel operator” ® applied to the ring of theta-constants 
of genus g gives a surjection to the ring. of theta-constants of genus g—1. 
Since T,(1) operates on the ring C[6m6,] of theta-constants, this combined 
with Lemma 4 shows that the modular forms môn belonging to T,(4,8) have 
no common zero in the quotient variety T,(4,8)\&, and its boundary. There- 
fore we can apply Lemma 6 and conclude that A(T,(4,8)) is integral over 
C[6m9n]. On the other hand, we know by Theorem 4 that the subfield 
C(Om/On) of F(T,(4,8)) contains F(T,(1)). Since F(T,(4,8)) is a finite 
Galois extension of F(T,(1)), we can apply the theory of Galois to determine 
C(Om/On). We recall that, if M is an element of I,(1), it gives rise to an 
automorphism of the graded ring A (T,(4,8)), hence of the field F(T,(4, 8)) 
as we explained. In this way, we get an epimorphism of T,(1) to the Galois 
group of F(T,(4,8)) over F(T,(1)) with T,(4,8)(+1,,) as its kernel. 
We shall examine the condition for M to keep C (m/n) elementwise invariant. 
The condition is 0m(M-*-r)/@n(M-*-+) = Hm(r)/On(r) for all even m, n and, 
replacing 7 by M-7, we have the same condition with M> replaced by M. 
If we apply the transformation law of theta-functions to this condition, we 
see that On(r)Ou-n(t) and On(r)@x-m(r) differ by a constant factor. We 


16 
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apply By and Cy to r in (6m(r)Oa-n(7) )? = const. (n(7)Oxe-m(r))? and we 
get m+ M-ne=n+ M-mmod2, hence *M-*(m—n) =m—nmod2 for all 
even m, n. This implies M=1,,mod2. Therefore, as in Section 1, we can 
express M as a product of powers of Ay, By, Cy with exponents given by p, 9, 
r and of an element of the commutator group of T,(2).: Then the condition 
On (Mr) /On(M-r) = Om(r)/On(r) can be translated by Theorem 3 into 


Daum mi’ + > umim + E rym’ m’ = 0 mod 2 
hj ‘Sj i<j 
2 galmi)? + X ru(m”) = 0 mod 4 


for all even m. It is an elementary exercise to see that this simply means 
(q)o= (r)o= 0 mod 4, gq==r=0mod2 and p=p."1,mod?2. Therefore 
either M or — M is contained in T,(4, 8), i.e. M is in T,(4,8)(+1,,). This 
implies C (m/n) = F (T, (4,8)). Since C[0m0n] contains elements of degree 
one, therefore, the field of fractions of A(T,(4,8)) coincides with the field 
of fractions of C[0m9n]. This completes the proof of Theorem 5. 

In order to derive some consequences from Theorem 5, we observe the 
following. Let R be an integral domain and suppose that a group T operates 
on R as a finite group of automorpisms. Then the invariant subring of the 
normalization of R is the normalization of the invariant subring of R (in 
the respective fields of fractions). Therefore, if T is a subgroup of T,(1) 
containing T,(4,8), then A(T) is the normalization of the invariant subring 
of C[m6,] with respect to T. In case T is contained in T,(2), the invariant 
subring can be obtained in the following way. Suppose that y4,-- >, Yẹ form 
a maximal set of linearly independent monomials in 6m of ‚degree 2k, say, 
over C. Then, for every M in T,(2), we have 


M-( È ow) =— ÈZ ol-w—= D const. yi 
1StSa Iian 1Si=sn 


where c,,° * *,c„ are in C. Therefore the invariant subring of C[4m6,] is 
generated by invariant monomials. Furthermore, if we put 


Y == On,‘ . “Omas 


the invariance condition can be translated by Theorem 3 into some condition. 

on the coefficients of ma’ --, Maz. If we take T,(4) as T, for instance, the 

condition is > 
2 Mat = = Mat” = 0 mod 2 


in which æ runs over 1,---+,2k. If we take T,(2) as T, the condition is 
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(may)? =] (ma) =0 mod 4 
a a 

> Mal Maj == > Met’ Maj” =0 mod 2 
a a 

2 Mal Maj” =k G=j),=0 (ij) mod 2. 


Also, if we take T,(2,4) as T, the first congruence becomes mod 2 and it will 
be contained in the second congruence. In any case, if we normalize the 
coefficients of the characteristics to 0, 1 and consider the multiplicities of even 
characteristics as unknown (non-negative) integers, the condition can be 
transformed into a finite number of homogeneous linear Diophantine equations. 
Therefore the invariant monomials form a finitely generated monoid and we 
can determine the generators. 

In the simplest case g==1, the ring C[6m6n] is normal. In fact, the 
Riemann theta-formula implies 


(900) * — (81) * — (610) * = 0 


and, since the polynomial (Xoo)*— (Xo1)*— (X10)* is absolutely irreducible, 
we see that C[@m] == €[ 00, 901, 910] is (canonically) isomorphic to the quotient 
ring of C[X] by the principal prime ideal generated by (Xoo)*—— (Xo1)* 
— (Xio)*. We can very easily derive from this fact that C[@m], hence also 
C[fmfn] are normal. Therefore, following the general procedure we explained 
and using a standard notation,® we get 


A (Ti (4, 8) ) -C [Om] en C[ 600, Boxy 610] G 
A(T1(4)) =C[(6m)*],  A(Ti(2,4)) = C[ (fm) ]® 
A(T1(2)) =€[(Om)*] = CL (8o) 4, (910)*]- 


On the other hand, we observe that T,(1)/T,(2) is isomorphic to the sym- 
metric group 7, of permutations on three letters, which we can identify with 
the three even characteristics mod 2, and the representation on A(T,(2))s 
is its unique (up to equivalence) irreducible representation of degree two. 
Since A(Tı(%)) is (canonically) isomorphic to the graded ring of poly- 
nomials in two letters (each having degree two) with coefficients in C, we 
know the action of T,(1)/T;(2) on A(T,(2)) completely. In particular, we 
have 


"If S is a graded ring composed of homogeneous parts 8, with k running over an 
additive monoid J and if d is a positive integer, then 
SO = O Ba. 
kel 
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© dime A(T, (1)) ef! = 1/(1 — t) (1— t°). 
OSkcw $ 
Also we see that A(T, (1)) is generated over C by 


Ya = F ((B00)® + (Bor)® + (910)°) 
Yo =F ((B00)* + (Bor)*) ((800)* + (B10)*) ( (Box)#— (B10) 4) « 


Because the Siegel operator ® maps both y, and ys to 1, they coincide (in- 
cluding the constant factors) with Eisenstein series of weights four and six, 
which we shall explain in the Appendix. Moreover the kernel of ® is the 
principal ideal generated by l 


(ya) = (ye) 2 = 83/22: (800901910) 5 


The corresponding situation is fully investigated in the case g == 2 in the paper 
mentioned in the introduction. 


Appendix. 


In this paper we gave a foundation for the construction of modular forms 
by theta-constants. Historically, this was. the first method by which elliptic 
modular functions were (discovered and) investigated by Gauss. However, 
in the case of higher genus, the method originated by Eisenstein (and Poincaré) 
has been widely used. The essential point of this method can be stated as 
follows. Suppose that A is the subgroup of Sp(g,R) consisting of elements 
with left bottom squares equal to zero. The group A is the stabilizer of the 
0-dimensional boundary component limtyl, for „>». At any rate, for any 
subgroup T of Sp(g,R) commensurable with T,(1), we define an Eisenstein 
series belonging to T after Siegel by l 


a! (7) = D det (er + d)* 


in which k is an even integer and the summation is extended over elements M - 
of T composed of a, b, c, d modulo left multiplications of elements of A. 
According to H. Braun, this series converges absolutely and uniformly in 
every compact subset of ©, when and only when k>g--1. Moreover, for 
such values of k, the series defines a modular form of weight k belonging to T. 
Furthermore, as it follows from the work of Siegel [9], the ring A(T)® is 
the normalization of.the graded ring generated over C by the Eisenstein series- 
at least for T—T,(1). In the two special cases g == 1,2, we know. also that 
A(T,(1))® coineides with this graded ring of Eisenstein series. Now we 
shall show that this is no longer true for g>2. We need the following 
theorem: 
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THEOREM 6. The group T,{1) is generated by ANT,(1) and by the 
g matrices Di equal to E for g=1 in the (4,t)-, (itg); (t+ 9,%)- 
(t+ g,t+ g)-cosfieients and to lag in the remaining coeficients. More- 


over, tf 
a b 
| c a 
is in ANT,(1), we have z(M)'—det(d)— +1 and for i= 1, -,g we 
have #(D,)? —=e(4). 

The first part of the theorem is well known [cf. 7, p. 153] and is easy 
to prove. In the second part, the fact z(M)?det(d) —1 is straightforward 
while 2(D,;)? == e(4) follows from Lemma 2. 

Now, consider the following polynomial 


I (t= (On)*) =P + 


in the indeterminate t. Then, using Theorem 6 and the transformation law 
of theta-functions, we see that the coefficients of this polynomial are invariant 
by the operations ‘of T,(1). Hence they are modular forms belonging to 
T,(1). If we apply the Siegel operator g-times to the coefficients, the poly- 
nomial will become (t— 1)”. In particular 


v-1/ E (0n) 


is a modular form of weight four belonging to T,(1) and it is mapped to 1 
by the g-th power of the Siegel operator. Hence y is different from zero, 
and it is not contained in the graded ring of Eisenstein series for g > 2. 
This proves the assertion. Incidentally, the Riemann theta-formula shows 
that we have 


yom 1/207 (29 —1) De(lm,n) (Omn) 


where the summation is extended over all distinct pairs (m, n) of even charac- 
teristics mod2. At any rate, the fact that Hisenstein series do not exist for 
smaller weights is a drawback and, although the method of Hisenstein-Poincaré 
is convenient to prove general qualitative theorems, the Gauss method to use 
theta-functions seems more suitable to investigate finer properties of modular 
varieties. 
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THE BASIC ESTIMATE OF THE 3-NEUMANN PROBLEM 
IN THE NON-KAHLERIAN CASE, 


By M. E. Asz. 


Introduction. Let M be an open submanifold of a complex analytic 
manifold M’ of complex dimension n. We assume that the closure of M is 
compact in M’ and that the boundary bM of M is a (2n—-1)-dimensional 
submanifold of M” of class C*. Denote by @>« the linear space of complex 
valued differential forms of type (p,q) on M, and let Ara consist of those _ 
elements of @** which are differentiable (C°) on the closure of M. If 
pE Ara, we note that the complex conjugate & of ¢ belongs to Qa. 

A Hermitian metric 
(1) ds? —= hide! Q dz 


on M’ allows us to define the Hermitian inner ehe ow of K yE Ure at 
each point of M. There is then a map 


*: Am Grune 
such that *(1) is the volume element‘ on M. The (global) Hermitian inner 
product and norm on (ir are defined by the equations 
(Wf evel) oan 
M M 
| $ [? oa ($, $). 
We have the usual operators 


{ ö : (ma (pet 


9 Uri» Geet 
and the Green’s formula 


(51,6) — (099) Ze 
WE dee, gE (re, 


(2) 


Received December 10, 1962. 

Written while the author was a National Science Foundation Graduate Fellow. 
The author is indebted to Professors J. J. Kohn and D. C. Spencer for several helpful 
discussions concerning this paper. 


247 





248 M. E. ASH, 


Let ge >, The condition that (dy, ¢ en (1,86) for all ye den is, by 
this Green’s formula, a boundary condition for ¢. 

In order to solve the é-Neumann problem, J: J. Kohn [2,3] has derived 
an a priori inequality for € (4 satisfying this boundary condition. The 
‚idea for such an inequality camé from a paper of C. B. Morrey [4]. Kohn 
requires that the submanifold M of M’ be strongly pseudoconvex and that 
the Herimitian metric be Kahler near bM. (Strong pseudoconvexity implies 
that such a metric exists.) The purpose of this note is to prove the inequality 
without this Kahler assumption (see § 4). Our method is to make the 
necessary computations in an orthonormal frame. In this setting certain 
difficulties involving the raising of indices are not encountered. 
er It might be mentioned that an analogous inequality was proved (following 
Kohn’s technique) for complex multifoliate structure in the author’s thesis [1]. 


1. Orthonormal frames. Let (zi,- -+,2") be a holomorphic coordi- 
nate sh on a coordinate neighborhood U. The differential forms 
(det, --,dz") span the space of differential forms of type (1,0). The 
inner product defined by a Hermitian metric (1) is given by dzi- det == h®, 
where (h*/) is the inverse of the matrix (Miz). We cah apply the Gram- 
Schmidt orthonormalization process to obtain a local basis (w*,- - -,w*) of 
the space of differential forms of type (1,0) auch that w: wt == 8t, We have 
w! == G,!de*, where the ax? are O” functions. 

In such an orthonormal frame the volume element has the expression 


#(1)—=(V—1)" A+ Ao AoA. Ao 
A differential form ¢ of type (p,q) can be expressed in a moving frame as 
p = dire! A ok 


2 E bene A A ARM A A ot, 
ILe <p Bat ka 


Here, J denotes an ordered set of integérs jı <` -< jp and Pin ink ke 18 
assumed to be antisymmetric in j,- - -f, and Ee ky The inner product 
at a point of $, y € G4 is given by 


p: y= D grb. 
JE 
The element +f has components 


(vb) (— 1)e(V—1)"S EXLEIMPIE: 
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Here, en- is the sign of the perniutation (i,- - -i,) or zero if there are 
repeated aes l 
4 8. 

Let — Fol? a 
quite correct (see (4) below), but it is suggestive with regard to the calcu- 
lations we shall be making. The operator ĝ has the expression 


— be the tangent vectors dual to wl, ot. This notation is not 


- d 
(8) ip 


where the dots denote terms which do not involve the derivatives of the 
components of ¢. These terms arise because, for instance, 


But = cmo! 


-r N JAE 


is not necessarily zero. We also have 
fot — — Emro” A ot. 
Since ĝðg == — 4g for any function g, we see that 
ag ag 
(4) -a a A 
The operator ® has the expression 








(5) Bp = (S SE I AEE 


We have shown how the calculus of differential forms on a complex 
analytic manifold appears in an orthonormal frame. Conversely an almost 
complex manifold is essentially a C” manifold which is covered by such 
frames on which the operators ô and ĝ are defined. The integrability con- 
dition is 0, or, equivalently, 44—— 69. (See [5], pp. 30-35.) There- 
fore, in the following we shall asume that W’ is an integrable almost complex 
manifold with a Hermitian metric. 


2. Strong pseudoconvexity. Let |r(z)| be the geodesic distance of 
ze M’ to bM, and suppose that r(z) is negative if ze M and positive if 
ze M’—M. The volume element on bM is #(dr). 


Definition. The submanifold M of M’ is strongly pseudoconvex if and 
only if for any tangent vector r of type (1,0) at a point of bM, the condition 
<ðr, ry = 0 implies that (Br, r A P> > 0. 

The symbol < , > denotes the contraction of tangent vectors and dif- 
ferential forms. Note that 
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<66r, TAD = ciir, F A TY 
on an integrable almost complex manifold. ‘The function r in the definition 
could actually be any function such that r <0 on M, r= 0 on bM, eandr>0 
on M’—M, with dr=£0 on bM. 
It is a simple computation to show that the strong pseudoconvexity 
condition above can be expressed in a frame in the following manner: at each 


point of bM the condition r ar =0 implies 





Pr or 
(6) (nt z) Fin > 0. 


3. Integration by parts. Let f and g be functions on M’, and suppose - 
that they have support in a coordinate neighborhood so that our manipulations 
in a given orthonormal frame have meaning. Then 


EVD A Ao Aol A+ Not ATA AR] 
= (Hah g(t) + (arg (1) 
+), 


Er 8, is defined by this equation. Let T denote the tangential part of a 
differential form on bM. Then 


TUV-Dre A No AoA Au ATA AB 
| ir (dr): 
Since 
| ee, 
we see that | 
a= (ee, 


From the above equations and Stokes’ theorem we obtain 


(7) Sure ae Sie + [10% san) 
wa #981 (1). 


Similarly, we have (integrations are over M unless otherwise specified) . 
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Se Sr anf ins) 


Applying (7), then (4), and finally Om) we obtain the nono wing formula 
for integration by parts 


ae ie "u 


(9) wat Gar fat Gat prl 


= uns 
where 
wm ft ome rer Szene) 
+f aT + f tsi + (FE ose) 
+ f fg mO + f 988m * (1). 
Note that for any functions o, r and positive number C we have 


fels figellOrlsaa Slob +S Sieh 


Thus, we see that for any positive number e there is a positive number K (e) 
such that 


(0) [wised f U Zee +i BODHO fire lgo. 


4. The basic d-estimate. The considerations used in §3 of [3] to get 
the boundary condition from Green’s formula (2) are exactly the same in an 
orthonormal frame. Thus ¢€ dr satisfies the condition 


(öy, $) = (4,98) 
for all ye (p+ if and only if at each point of bM 
(11) Ser aut. 
w 


Let U be a coordinated neighborhood in M’ and consider ¢ € (rt restricted 
to U. We define the absolute value of ¢ at each point of U by the formula 


252 x. BASH, 
dt: | oye |? 
1k 


and the norm of all barred derivatives of & by the equation 


a 
ters EN aca). 
JkiY Mou 
Then we have the following result (see [8], Theorem 5. 6) : 


Tuzorsm. Let M’ be an integrable almost complex manifold with a 
Hermitian metric and suppose that M is a strongly pseudoconver submanifold 
of M’ with a regular boundary bM. For each point of bM there is a coordinate 
neighborhood U in M’ and a positive number C such that if ge Ama, g>0, 
has support in U and satisfies boundary condition (11), then 


1% + 186 °+ e= eltt f leled) +i). 


Proof. If o,7€ Ê and C is a positive number, then 


OS1Get Hl lo l+ Ctr]? +2Re(o,7). 
Letting C? == 2, we see that 
lor |? lo]? +] 7]? +2 Re(s,7) 

Z4 lo l?— l7 | 
Thus, (5) gives that there is a positive number A such that 


(12) 


er SEE) Ale" 
JKim w do" 


Applying formula (9) for integration by parts, we obtain 


1 232 (RE EEE oc) 








= Ss ue _ O¢int Or 


=f De En Sn ]*(dr) + W. 


where, by (10), for any positive number e there is a positive number K (e) 
such that 


(14) |\W|Selelat Keep 
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Note that we have absorbed the term A || ¢ ||? into W. 
Differentiating the conjugate of boundary condition (11) with respect 
to o!, we have 
Agim Or or on 
Zgor aa T A Prnt A TG OY Gat 
This is because if f — 0 on bM, then df — À dr on bM. Multiplying by ¢7iz and 
summing on J, we see that 


ag, or ` 
> pE rs + 2 bıirdımk wer 
=À 2 ee a = 0. 


This last step follows from (11). Thus we have 








rd ör 
2 sikl: Sine gga + Bm ]—2F in@ritbsn, 
where 
Fr ug ot 
Fa oim E gF’ 


Boundary condition (11) and strong pseudoconvexity condition (6) give - 
z Fimpnizpsar > 0. 


Since (Fy) is a Hermitian matrix (see (4)), there is a positive number 0 
such that . 





29 p R uf jew + onic 5] 
(15) = 


Boundary condition (11) shows that the first and fourth boundary 
integrals in (13) are zero, and hence we obtain from (15) that 


Joe ray EEE aa) 
(16) 
+o f lelts(ar) +W. 


From (3) and (12) we see that there is a positive number A such that 
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A 2 boil _, is mL ||? 2 
Lap PEA Foe om Ao’ AvP —A I Sl 


= Bobs ac 

aS Ge | 
Obst, dba 

TES anzu) Bam ei 


Here, (mL) represents the unordered sequence ml,- - -la Let <mL> denote 
the set (mL) ordered in increasing order. Then 


l 0 if <mL> <M 
cm”! FI 


art) —A | o |. 


—e K «e mk if L—<IK>, M=<mK> 


<K> <mK> 


and we have 


~ ddr lpsmE 
I l= tlel — tE J 7m aar tC) 
—41$1” 


Inequalities (16) and (17) combine to give 


er + sera’ f Jolla) 


+W—Alel?. 
By (14), this completes the proof of the Theorem. 
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ZEROES OF POLYNOMIALS OVER FINITE FIELDS.* 


By James Ax. 


1. Introduction. Let FF(Xi,---,X,) be a polynomial of (total) 
degree d over a finite field k with q elements. In section 3, making use of 
some ideas of B. Dwork in [2], we prove the following theorem: 


If b is the largest integer (strictly) less than n/d then qè divides the 
number of zeroes of F. 


E. Artin had conjectured that if F is homogeneous and n>d then F 
has a non-trivial zero. ©. Chevalley proved this in [1] and even showed 
the hypothecis of homogeneity could be replaced by the weaker assumption of 
no constant term. E. Warning in [4], using a lemma of Chevalley, showed 
that even without this last assumption the characteristic p of k divides N (F), 
the number of zeroes of F (counting the trivial zero if F has no constant term). 
In Section 2 we give a quick proof of the Chevalley-Warning theorem inde- 
pendent of the Chevalley lemma. Nevertheless, there does not seem to be any 
simple proof of the fact that q divides N(F) if n >d. 

In Section 4 we exhibit, for each n and d, a polynomial of degree d in n 
variables such that the highest power of p dividing the number of its zeroes 
is precisely q? if b is the largest integer less than n/d. While our result is 
the best possible divisibility relation in this sense, E. Warning in [4] showed 
that if n > d and if F has at least one zero then N (F) is at least g*-¢. 

The zeta function Z(H ; t) of the hypersurface H defined by F over k is 
defined by 


Z(H;t) —exp( > N,t*/s) 


where N, is the number of zeroes of F in the field with g* elements. Let Q 
denote the completion of the algebraic closure of the p-adic completion of 
the rationals, and let | | be the valuation on Q normed so that | p | == 1/p. 

The referee has shown how our result may be reformulated as the following 
statement, using the above notation. 
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THEOREM. Each pole and each zero of Z(H;t) has p-adic valuation at 
least q’. 
Indeed, it follows from the rationality of Z(H ;t) [2], that 


exp( & Nett/s) = TIL — at) /I(1— Bit) 


where the æ, 8;.gre algebraic integers, af, for i and j ranging over finite 
sets. By logarithmic differentiations we obtain 


SN i= ZB Zaat). 


If we now assume our result, | N, |< | g» | = q-, so that the left side 
converges in Q for |t| <q’, then | «|, | Ay E = g? which verifies the referee’s 
statement. The converse follows from 


N = Bs = x Oye 
Throughout this paper, F, N (F), n, d, b, k, q, and p are above. Z denotes 
the integers, Z, the nonnegative integers. If u== (a#,: ",w) €(Z,)", Xe 
denotes the monomial Tx and we define height u= degree X* = Sy. 
> So Mogae i eas Fo 
2. Quick proof of the Chevalley-Warning theorem. Since each element 


of k isa q—1 root of unity or zero, we have for each zE kn that 1—E (s) 
= 1 if F(x) =0, zero otherwise. Summing over zE kn, we ‚have (in k) 


(1)? N(F) =S(1—F(2)) =— I P (2). 


Now Fe, being of degree d(9—1) is a k-linear combination of monomials 
of degree at most d(g—1). If X* is such a monomial, we compute 


(2) Seal | > z“ — Ji Y (u) 

where F (14) = q — 1 == — 1 if % is positive multiple of g—.1, zero otherwise. . 
If d< n, then height u S d(q— 1) <n(q—1) which implies that the sum 
in (2) is zero. Hence, the sum in (1) is zero, i.e, N (F) ==0 mod p. 


3. Proof of the theorem. Let g= p’, Q, be the p-adic completion of 
the rationals, and K the unique unramified extension of Q, of degree f- Then 


3 This equation is the essential fact in our proof as in Warning’s. We then proceed 
directly to the result in a way suggestive of certain manipulations in the sequel. 
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the residue class field of K is k. Let T denote the set of Teichmüller repre- 

sentatives of k in K; let Pr), the g—1 roots of unity. Let & be 

a primitive p-th root of unity. If « is an integer of Qp, £* is defined to be ¢° 

if a( € Z,) is congruent to æ modulo p. Letting § denote the trace of K over 
i qi 

Q, we define C =2 c(m)U™ to be the unique polynomial of degree g——1 


with coefficients in KO) such that C(t) =O) for all GET. Summing 
C(t)t4 over te T* we find 


(3) WED =g(j) for 0<j<q—1 where the Gauss sum g(j) 
is defined for Oj <g—1 by 


gG) = De®  (tET*). 


Summing C (t) over t€ T* and using that the trace function is not identically 
zero on & finite field, we find 


—1—=9(0) = (¢—1) (e(0) + e(g—1)). 


Since 

(3°) c(0) =1, 

we have 

(3”) e(q—1) (9—1) =—4. 


BUST Ste eae ost be such that 0S 7,3 p—1 and 

jea Saat We set o(j) ~ Sis pCi) =j andA=L—1. Then Stickel- 
4=0 

berger’s congruence [3] ee [2] for firin reference), 


9(9)p(7)/A ==—1 modà for OS7<g—1 
together with (3), (3’), and (3”) certainly imply 
(4) ec) 0 moda) for OSjSq—-1. 


The map «— ¢S@ is a non-trivial character of the additive group of the 
integers of K, trivial on the maximal ideal of the integers of K. Thus the 
map ß from k to the pth roots of unity defined by (£) C(t) for 2€k 
and t the Teichmüller representative of z is a non-trivial character of the 
additive group of k. If ue k, then $ B (zou) =q if u =0, zero otherwise 
where the sum if over z,€ k. It follows that ` 


qN (F) =E p (oF (2u: + >%e)) (lan 0) E BM). 
| 
t 
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Let 
Bom ¥a(w) Xe (we W) 
where W is the set of we (Z,)" such that height wd. We have 
aN (F) = ILBlatw)ar) — (@— (au ` +, En) € kt) 
where if w= (wW, °°, Wa) €(Z,)" then w’ == (1, w1, > +, Wa) €(Z,)". IE 
A(w) is the Teichmüller representative of a(w) for each we W, then 
an) 3, TL C(A(w)t) (E= (tay + =s te) € Ten) 
and so 


NM) $ IL Sic(m)A(w) mime’ 


te TR we W m=0 


2,211 (c(m(w) )4 (w) mme) 
meM tET™ w 
where M is the set of functions on W with values from the integers 0, 
‘,Q—1. Setting a(m) — IL Agee ET, e(m)’== $, m(w)w’ for 
we weW 


me M, we may rewrite (5) as 
(8) qN (F) = 2 a(m) Lsmtw) en 
. te putt 
If v€(Z,)" we write g—1|v if there exists ué€(Z,)" such that 


v= (qg—1)u and g—1fv otherwise. Let m be an arbitrary element of M. 
Then we easily compute 


(5) 


(6) a i =o it g@—1f o(m)’ 

and 

(6°) > dem)" g1 if e(m)’— (0,- < 0). 
te gat 


We now assume g—1| e(m)’ and 6(m)’54 (0,- - -,0), ie, m(w) 5£0 for 
some we W. Let e(m) — > m(w)w and let s be the number of non-zero 
wW 


entries in e(m), O&S s&n. We have 
iger if g—1 | efm) a (0, + +, 0) 
€ [n+l 
taking into account that the first entry of e(m)’, > m(w), is a non-zero 
weW 
multiple of g—1. For each we W, let mı(w) for im0,- - ‚f—1 be such 


f-1 
that m(w) =È mi(w) pt and 0=m,(w) Sp—1. We extend the definition 
of m,(w) to all z€ Z by letting m,(w) —m,(w) if r is the least non-negative 
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residue of z modulo f and define for each j= 0,: > +,f—1 the function 
mD EM by 


(7) mn (10) =S m (w) pt 


Using tt for all GET, we readily compute that the effect of substituting 
m) for m in the sum in (6”) is the same as if we formally substitute ir’ for t, 
i.e„ no change since {—>H# is a permutation of T. We deduce from the 
mutually exclusive (6), (6°) and (6”) that q—1 | e(m(P)’, and the number 
of non-zero entries of e(mÜ)) is again s for each j==0,--:,f—1. This 
yields the inequalities 
s(g—1) Sheighte(m®) = height X, mi(w)wS dS mM (w). 
wew weW 
Since $, mW) (w), the first entry of e(m)’, is a multiple of g—1 we conclude 
weW 
(3/2)*(g—1) S X m” (w), 
weW 


where (y)* means the smallest integer not less than y. Summing this relation 


over j==(,- - +, f—1, using (7) and interchanging order of summation twice 
we obtain 


f(s/d)*(q—1) S$ SpE mylo). 
weW 4-0 j= 
Thus with o as used in (4) 


f(s/d)*(q—1) SB Iron). 
So 
H(p—1) (s/d)*S ¥o(m(w)) 


which in view of (4) and the fact that p divides A?! implies the exponent 

of the. highest power of q dividing [[ c(m(w)) is at least (s/d)*. Com- 
weW 

bining this with (6), (6°), and (6”) we see from (5’) that 


(8) l q |g(N(F) if r=minr(s) 
where 

(9) r(s) = (s/d)*+n—s, s=0,1, n. 
Now l 


hE ((s+h)/d)*— (s/4)*, keZ, 
since in going from h to h +1 the left side increases by one while the right 
side increases by at most one. Substituting h ==n—s in the relation and 
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using b- 1 (n/d)* we see from (9) that r(s) =b+41 for s—0,- < -n 
By (8) g? divides N(F). 
CoRoLLARY. If F, is a polynomial in n variables of degree dy for 
il, ,j then the number N of common zeroes of the F; ts divisible by 
i 
Pifn>bNd: 
= r 4 t 
Proof. A standard combinatorial argument shows 
N ==— J, ("N (IL Fs) 
8 € 


where the sum is over all non-empty subsets 8 of the set of integers 1,- - -,j 
and where #9 — number of elements of S. The corollary follows from the 
theorem since for each S, 


degree I] FiS S di. 
ses 4=1 
4. Examples. If acZ,&> 0 we define 
Goa(Xu' © ts Xaa) Xr Kat + Xian’ ' "Los 
and assert that the highest power of p dividing N(G,.) is qi Now 
N (Ga) —g@— (g—1)% N (Gana) —N (Gaa) times the number of zeroes 
of X(eayau* ' Xea (in kt) plus the number of non-zeroes of Gag (in ket) 
times the (constant) number of representations of a non-zero element of k 
by X oad’ “ -Xas (in kå), i.e, 
N (Garna) = N (Goa) N (Gua) + (Q —N (Goa) (q—1) 
= GN (Goa) (> — (g—1)4*) + gt(q—1) 
For d>1 this yields our assertion recursively; for d=1 our assertion is 
immediate. If n=-bd-+h with 0<ASd (so that b is largest integer less 
than n/d) we set 
F(X," + +, Xn) = Gra (Xu: +, Xva) if hI, 
F(X: " -, Xn) == Oya (Xa: ` * Xvi) + Xin: 2. Xn if h>1. 


(10) 


We assert that the highest power of p dividing N(F) is q?. 


If h=1 this follows from our previous assertion since in this case N(F) 
= qN (Gra). If h>1 our previous assertion still yields the desired result 
since by reasoning similar to that used in establishing (10) we have 


N(F) = qn (Goa) (N) + glg — 1) 
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A NOTE ON HERMITIAN FORMS OVER FIELDS 
OF CHARACTERISTIC 2. 


“By Curm-Han San.* 


In a short’ note, J acobson [5] s showed that over “nice” fields of charac- 
teristic ~2 with an involution, the. problem of field equivalence between 
hermitian forms may be reduced to one of field equivalence between two 
quadratic forms. ‘Using this, he obtained a complete set of field invariants 
for hermitian forms over a large family of fields. Recently, Jacobowitz [4] 
obtained a complete set of invariants under integral equivalence for “nice” 
local fields of characteristic „+2. The purpose of this note is to show the 
restriction on the characteristic is not necessary for either problem. The 
main results are contained in Theorems 1, 2, A, B, and C. We assume 
familiarity with [2]. 


1. Reduction of hermitian forms to quadratic forms. 


Definition 1.1. E, * is called a “nice” field if and only if one of the 
"following conditions hold: 


0). E is commutative, x(E) 42, * is the identity map of F, F =F. 
1). E is commutative, * is an automorphism of order 2, F is the fixed 
field of *. Hence, [E: F] —2. 
2). E is a reflexive division algebra with respective to *. F is the center 
of E. Hence, [E: F]=4. If y(#) 2, F is the set of fixed points of *. 


If x(#) = 2, the fixed points of * has dimension 3 over F as a vector space. 
For details, see [3; p. 78, p. 84]. 


. In all cases, for AEE, T(A) =A+A*=—T(A*) and N(A) =AA* 
—N(A*) both lie in F. E* and F¥ will denote the non-zero elements of E 
and F respectively. 


Remark. In case 0),x(Z) =2 will lead to “symmetric matrices,” which 

is not the same as quadratic forms. Similar results may be obtained. Since 
! 

these are analogous to Section 4 and much simpler, we will exclude it from 


discussion. 
Received February 21, 1963; revised received December 19, 1963. 
* This work was prepared under NSF contract G-23833 at Harvard University. 
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Definition 1.2. Let V be a vector space over a “nice” field E, *. Then, 


1). SHV) is the set of all maps {, }: VX V—V such that {, } is 
E-linear in the first variable, (z,y} = {y,2}* and {z,z}¢€ F. The set #(V) 
is an F-vector space by using the F-vector space structure of V. Thus 
ao {x,y} —=a{z,y} defines ao{ , }, where a€ F. 


2). 2*(V) is the set of all maps Q: V —>F such that 


<z, y> = Q(z +y) — Q(z) —Q(y¥) 


is bilinear over F and Q (Az) = N(A)Q(z) for ACH. Asin 1) 2*(V) is 
an F-vector space. It is a subspace of the F-vector space of all quadratic 
maps on V, where V is considered only as an F-vector space. The conditions 
imply that AA*<Az,y) = <Ar, AA*y) == AA*z, A*yS. ‘Thus we have, > 


(*). <Ag,y> — <z, A*yS for z,y€ V and AEE. 


THrorem 1. Let E, * be a nice field. V an E-vector space. For each 
{,}€ &(V), let Q: VF be given by Q(x) = {z,r}. This then gives an 
F-isomorphism between Y (V) and 2*(V). 


Proof. Since E, * is a nice field, the map N: E —>F is a non-degenerate 
quadratic map on the F-vector space E. Let w,v,;€ E- be a pair of dual 
basis of E over F with respect to the associated inner product < , >. The 
construction of {z,y} in terms of <z, y> is then given by {x,y} = > <x, uy>ui. 

5 4 
This is the inverse of the map given in the theorem. Its verification follows 
from (*) and the fact that tų, vy are dual bases of E over F. @ E.D. 
(We are indebted to the referee for the above unified proof.) 


Comparing Theorem 1 with the results of Arf [1], we have, 


THEOREM 2. Let E, * be a “nice” field of characteristic 2 such that 
every quadratic space of dimension greater than 4 over F is isotropic. (E.g., 
F ts a global or a local field.) Then, every non-degenerate hermitian space V 
over E ts H-equivalent to one of the following: 


1). [E:7]=4, V={1} 9: -@ {1}. 
2). [E:PJ=2, V={1} @-- -@ {1} @ {4} 


® is used to denote orthogonal sum, {a} is an 1-dimensional hermitian space 
with basis z such that {z,2}==a. The quantity d>£0 determines-a unique 
coset in F¥/N(E*), called the discriminant of F. 


2 
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- 8. Preparation to integral theory. From now on, we will assume that 
E, * is a “nice” local field with x(E)—=2. Thus F—=0<<r)), where Q is 
a finite field. o—O[[z]] and O = integral closure of o in E. orda and ord, 
are the ordinal functions in E and F respectively. T(O)—r’o, s a non- 
negative integer. If E contains an unramified extension of degree 2 over F, 
then s==0. Conversely, if s = 0, then by using Hensel’s lemma, it follows 
that Æ contains an unramified extension of degree 2 over F. We will call 
8 = 0 the unramified case and s > 0 the ramified case. Ug and Ur will denote 
the units of O and o respectively. l 
` In any case N(Us) C Ur. In the unramified case N(Ug)=— Up, [8; 
p. 90]. If E, * is reflexive, then every commutative quadratic field extension 
‘of F may be embedded between F and E. This may be shown by using that 
every quadratic space of dimension > 4 over F is isotropic and that under the 
quadratic map N, E is the canonical model of a non-isotropic quadratic space 
of dimension 4 over F. Thus this belongs to the unramified case and more- 
over NV (E*) = F*. 

In the ramified case, we take HEE such that ordg(I1) =1 and uplate 
a by N(1). 

Lemma 2.1.- In the ramified case, [E: F] =2 and we have, 

1). T(O) = ur, ordr(u) = 0, s> 0. 

2). T(00) = FT (IP*0) = z"o, n any integer. 

3). L-MOCN(D,). 

4). Urp/N(Ux) is a cyclic group of order 2. 

5). There is an additive map P’: Q->Q with kernel of order 2 such 
that N (1-4 pet p. - -) —L4+ P (u)r ++ + +, where nen. Thus we 


fia the choice of AEQ such that 1+ Am? determines the non-trivial coset 
of Ur/N (Un). 


Proof. 1 and H form an integral basis for O over o. Since T is linear 
over o and x(#) —2, we obtain 1) and 2). The rest follow from [8; p. 70, 
. pp. 93-94]. 

If L is a free O-module of finite type furnished with a Henker inner 
product, then Z is called a hermitian: lattice and the uniquely defined her- 
mitian space E®oL will be denoted by EL. We will always assume that L 
is non-degenerate. For a€ FF, b,ce Fand A€ E*, {a} and {,4,} will denote 
the hermitian lattices with free bases x and y, z respectively such that 
Q(z) = {z,1} =a, and Q(y) =b, {y,z}=—= A, Q(z)—=c. If the basis 
element is to be emphasized, we will write Oz = {a}, otherwise, Ox = {a}. 
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s(L) == {L,L} is an O-module of finite type in E. g(L) = {oQ(z)|c¢ L} 
is an o-module of finite type in F. L is called +-modular if for each ze L, 
zg IL, we have {z, L} = I0. L(t) = {z€ L] {z, L} C mio}. 


LEMMA 2.2. Let L bea hermitian lattice and M an i-modular sublattice. 
Then M is an orthogonal summand of L if and only if MC L(i). Thus L 
is an orthogonal sum of modular lattices each having dimension © 2. 


Proof. Cf [6; Proposition 1, p. 160]. 


Leama 2.3. Let L be a hermitian lattice. Then L admits a canonical 
decomposition of the form: 


L= @ L, dimo Li=r; > 0, L, is s(i)-modular, s(1) <- --<s(m). 
Any two such decompositions have the same type invariants r; and s(t). 


Proof. Of. [6; p. 161]. 


3. Unramified case. 


THEOREM A. Let E, * be unramified and L be a non-degenerate 
hermitian lattice. Then L admits an orthogonal decomposition of the form: 


L= ® L, dimo Li=rn > 0, L= {r} @- + 8 {m} 
s(1) <- + <8(m). 


Thus the type invariants form a complete and independent set of 
invariants for L. 


Proof. By Lemma 2.2 and Lemma 2.3 we may assume that D is 
i-modular of dimension < 2. 

I dimo L==1, then the assertion follows from N(Uz)—Ur. Thus 
let dimo L==2. From Lemma 2.2 and the case just considered, we may 
assume that L= Or + Oy = {,4,} with ords(A) < ords (a) Sordz(b). If 
[E: F] = 4, then modifying y by a unit, we may assume that A = „I, 
W =r and p -+u P (u) €O and P(a) é PQ. This follows from that E 
contains all possible quadratic extensions of F. Thus let z=z-+y, we see 
that Oz is an ortogonal summand of L. If [E: F] 2, then modifying y 
by a unit, we may assume that A == urt, where p?+p==P(n) EO and 
P(u) EPQ. Thus letting z—-c-+y again shows that Oz is an orthogonal 
summand of L. Q.E.D. 


COROLLARY. Let E, * be unramified and L, M, N non-degenerate her- 
mitian lattices. Then L@M=L@N tf and only tf Ma N. 
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4. Ramified case. 


Definition 4.1. We take I as in Lemma 2.1. A hermitian lattice H 
is called an i-hyperbolie plane if it is isomorphic to {949} with ord»(A) =i. 
All i-hyperbolie planes are isomorphic. An orthogonal sum of t-hyperbolic 

_planes is called an i-hyperbolie lattice. 


Lemma 4.2. Let L=H,@ L, jæ 1,2, be two decompositions of the 
hermitian lattice L. If H; are both i-hyperbolic planes, then L, = Da 


Proof. From hypothesis given follows that H,+H,C L(i) and 
{H Ha} CU. If {H,,H,} = OtO, then we may proceed as in case 1 of 
the proof in [7; Theorem 3.3]. If {H,,H.} CUO, then as in case 2 
of the proof in [7 ; Theorem 3.3] we may assume that L == H, 4+- H, and that 
L is i-modular. If dimọ L ==3, then a calculation of the discriminant of L 
shows that L, = L}. If dimo L= 4, then we proceed with the case 2 of the 
proof in [7; Theorem 3.3]. In all cases { , } and discriminant play the roles 
of <, X and Arf invariant respectively. 


Lemma 4.3., Let L be an i-modular plane. Then Q(L) =g(L). 


Proof. By considering aoL, we may assume that i=0 or 1 and 
Q(z) =x! where q(L) =rio. Thus, 272i. 

If 2j=i, then Lemma 2.2 implies that L= Or @ Oy = {a} ® {b}. 
Thus by Lemma 2.1 and modularity, we may assume that a == b = 1. Since 
à is a square in Q and == N (I), we see that Q (r -+ By) = 1 -+ Ar? can 
be solved for B€ O. Thus from Lemma 2.1, we obtain Q (L) =g(L). l 

If 2j >i, then 721. We can find y€ L such that ordg({z,y}) —i. 
Thus, L= Or + Oy = {443}, orda (4) =i < 2j = ordz (4) Sorda (b), where 
a’. By Lemma 2.1, we can find B with 


orda (B) >25 + 2s —2—=2(j+s—1)>0 
such that T(B*A) =r? (An). Thus 
s orda (N (B)b) Zy Hs —2 HZ 28 +j. 
Hence, 
Q(z + By) =r + T(B*A) +N (B)b =r! (1+ Amt 4 on), ordp(c) Z 0. 
By Lemma 2.1 again, we obtain g(Z) =@Q(L). Q. E. D. 


Lemma 4.4, Let L be an imodular lattice with dimoL>3. Then, 
L=MOH, where H is an i-hyperbolic plane. 


Proof. By Lemma 2.2, we may assume that dimọ L=8 or 4. 
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dimo L ==3. By Theorem 1, the quadratic space associated to EL 
has dimension 6 over F, thus must be isotropic. Hence we may assume 
that L = Or ® (Oy + Oz) = {a} @ {440}, orda (a) =— ords (4A) = orda (b). H 
orda (b) == i, then by Lemma.2.2, L = {a} ® {b} ® {c}. By Lemma 2.1 we 
may assume that a—b. By Lemma 4.3 we may then assume that a == b = c. 
Taking the basis elements to be z, y and z, then H =0O(z +4) +0(y +z) 
is an i-hyperbolic plane. It is an orthogonal summand by Lemma 2.2. If 
orda (b) >, then by considering «*o_L and modifying y, z by units, we may 
assume that a=A—=1 and b=ari(1 -+ eàr), e=0 or 1, O< jo. 
Replacing y by y—r’z-+y, we obtain Oy, + Oz = {o}, with ordr(c) = 2s. 
By Lemma 2.1 we can find CEO such that Q(y.+ Cz) =c+T(C) =0. 
Thus this sublattice is a desired hyperbolic plane. 


dimo L ==4. By the case just considered and Lemma 2.2, we may 
assume that L == L, @ La, dimo L=? and q(L) —=-lo, 2j>i. Again L is 
isotropic, we may therefore assume that Lı =— {440} and L= {nf}. By 
Lemma 4.3 we may assume that bo=g(L.). If ordr(a) Zordr(b), then 
~ by Lemma 4.3, adding an element of Lẹ to the first basis element of D, will 
give us an t-hyperbolic plane. Thus let ordr(a) < ordr(6) Sordp(c). 
Adding to the basis elements of L, suitable elements of ILL, will give us a 
desired, t-hyperbolic plane. f Q. E. D. 


Lemma 4.5. Let L be an i-modular plane, i—0 or 1 and q(L) = mlo. 


Then j Ss and for e=0 or 1, we have the following non-isomorphic normal 
forms for L: 


1). i=2j, L= {1} © (+). 
2). i< 2j, L= {ar}, a= ad, A m I, b= why tet, 


where e= 0 is understood in case s = j and i= 0. 
Furthermore, L is hyperbolic if and only if ]} =s and e =Q. 


Proof. By Lemma 4.3 we may assume that L= {„4,}, where a == r), 
A= I and ordz (b) 2j: I£ j >s, then the discriminant of EL is N(E*) 
by Lemma 2.1. Thus from Theorem 2, L is isotropic and we may assume 
that b==0 and ordz (a) =j. Letting z, y be the basis elements, ‘we see that 
Q (Bz -+ y) =N (B)z! + T(BI) will range over elements nòt in =*o by 
Lemma 2.1 and Lemma 4.3. Thus j &s, a contradiction. 


1) follows from Lemma 2.2 and Lemma 2.1. 
Let i<2j, I£s=j and t= 0, then we may proceed as in the proof of 
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s<;j to obtain the desired assertion. Moreover, a similar argument will 
give us the last assertion. The details will be omitted. 

Let 1<2j, j<k=ordr(b), where L= Os 4- Oy = {ss}, © is fixed, 
a—!, A=Il* and y is a variable such that k is maximal. Suppose that 
k<2s—1—j+i Le d=Q(Cze+y) =N(C)oi+T (CI) +b. Since 
0?—=Q, we can find C with ordg(C) =ordz(N(O))=k—j20 such that 
ordr(N(C)ri-+b) >k. Since 1<2j, we obtain that orda({z, Cs + y}) 
=ordg(C*ri +) =i. Thus for suitable BE Us, we may replace b by 
N(B)d, this contradicts the maximality of k. Hence we may assume that 
ordy(b) = 2s—-1—j-+%. By Lemma 2.1, we can find B = 1 -+ CH- with 
ordg(C) 20 such that «(1+ rtbb) = a!N(B) (1+ ar), e==0 or 1. 
Consider the equation {z, Dr + By} = D*r! + B*it—'. This may be 
solved with orda (D) = orda (B + 1) +i—2j2%—1—2j+4. Sinces2>j 
and i=0,1, the exceptional case s =— j, t= 0 has already been treated, we 
may assume that orda (D) =0. Upon replacing y by Dz + By, the diserimi- 
nant of L must be multiplied by the norm of the determinant of the trans- 
formation, i.e., by N(B). Thus, by computing the discriminant of L, we 
see that b may be assumed to have the desired form. The discriminant 
còmputation together with Lemma 2.1 show that the different normal forms 
are not isomorphic. Q. B.D. 


Tarorem B. Let L and M be i-modular lattices, both non-degenerate. 
Then, L=M if and only tf EL = HEM and q(L)=q(M). 

Proof. We only need to prove the sufficiency. From Theorem 2, Lemma. 
4.2, 4.4, we may assume that dimo L = dimo M ==2. After scaling, i.e., by 
considering ao L and ao M, we may assume that i= 0, of 1. The assertion 
now follows from Lemma 4.5. Q. E.D. 


Definition 4.6. Let L be non-degenerate hermitian lattice, then D(L) 
will denote the coset in F*/N (Upg) determined by the discriminant of L with 
respect to an integral basis of L. If SGF, then 


Orde (S) =l. u. b.{ordz (s) | sE 8}. 


Turor C. Let L=@®@L and M=®M, 1<Si<m 1<Sj<n, be 
canonical decompositions of the non-degenerate hermitian lattices L and M 
respectwely. Then L=M if and only if the following hold: 

1). ELEM. 

2). Land M have the same type, i. e., m =n, Li and M; are s(4)-modular, 
dimo L= dimo M; =r; and s(1) <--> :<s(m). i 
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3). g(L(4) D Hi) =q(M(t) © Hi) — “Wo, Hy an i-hyperbolic plane, 
s(1) Sisss(m). Thus, u(t) Zi and u(t+1) Z u(i). 

4). Orde(Di(L)/Di(M) +1) Zufi) +-u(i+1)—i(> 0), si 
<s(m), where D(L) =D(Li@-* -@ L) with s(j) Sı<s(j +1), simi- 
larly for D,(M). l 


Proof. By Lemma 4.2, we see that our conditions are “invariant” under 
the addition of hyperbolic planes simultaneously to L and M. Thus, we may 
assume that s(t-+1) —s(t) +1 and n>3. By Lemma 2.2, Lemma 4.5 
and Theorem B, we may assume that L; and M; have been broken down to 
orthogonal sums of lines or planes according to r, is odd or even. If L is 
replaced by ao L, ac Ff, then s(+) changes to s(#) + 2-ordp(a) and u(i) 
changes to u(t) +ordr(a). Thus the conditions are also “invariant” under 
this scaling operation. ` l 


Necessity. We only need to check 4). Using an argument similar to 
[7 ; Theorem 2.3, Lemma 5.4], we may assume that the two decompositions 
differ only in adjacent components each of dimension at most 2. Thus we 
may assume that m—2, rı & 2. If L, = {a}, then we only need to consider 
the change {a} — {a+ b}, where beg(L,). Thus the discriminant changes 
by a factor 1+a%b. But ordy (atb) = u(s(2))—u(s(1)), s(1) == 2u(s(1)). 
Thus we obtain 4), since the right side is positive implies that 4) is an equi? 
valence relation. If D= {44b}, then we only need to consider the change 
{afo} > {afto}, where cE q(La). If 2u(s(1)) =s(1), then by Lemma 4.4, 
we can break up L, and apply the preceding case. Thus let 2u(s(1)) >s(1). 
The ratio of the discriminants is 


1+ ac(W(A) + ab), orde(ac(W(A) + ab)+) >u(s(1)) + u (8(2)) —a(1). 
Since the right side is positive, 4) is an equivalence relation, hence we obtain 4). 


Sufficiency. The case m==1 follows from Theorem B. An argument 
similar to [7; Lemma 5.3] may be carried out, using Lemma 4.3 and Lemma 
4.4, to allow us to assume that Z and M are saturated in each component, i.e., 
q(L4) =q (My) re Wo, 1SiSm. By Theorem B and the necessity, we 
may assume that Lı — K, ® Hy, where dimo H= 2, q(K;) = q(Hi) =q (Li), 
D(#E,) =1, D(EH:) =1. Thus we may assume that H, = {,45}, a te), 
AI: and H: = {80}, ordr(c) =u(s(2)), orda (B) = s(2) = s(1) +1. 
By adding a suitable element of H, to the second basis element of H, and 
using Lemma 4.3, we may alter b by an arbitrary element of r*@(@)o. This 
transformation in H, ®H, will not destroy the saturation, but will, by 4), 
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allow us to assume that D(Z,)=D(M;). Thus Theorem B together with 2) 
and 3) will allow us to assume that L, == M,. The four conditions given will 
then imply a similar set of four conditions after we cancel out Ia and M. 
Hence by induction, we obtain that L= M. Q. E. D. 
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INVARIANT DISTRIBUTIONS ON LIE ALGEBRAS.* 


By HanisH-CHANDRA. 


1. Introduction. The object of this paper is to start laying the ground- 
work for the proof of Theorem 1 of [4(e)], which says, roughly, that the 
irreducible characters of a semisimple Lie group, which had so far only been 
known to be distributions [4(b)], are actually functions. Our method con- 
sists in splitting the problem into two parts. The first one deals with an 
analogous question on the Lie algebra (see Lemma 1 of [4(e)]) and the 
second with the task of lifting this result from the algebra to the group itself. 
In this paper we shall be mainly concerned with one of the principal steps 
[4(e), Lemma 2] needed in the first part. 

Our entire approach to the problem is based on a simple result (Theorem 
1) about a C” mapping = of a manifold M onto another manifold N, which 
has the maximum rank everywhere. This allows one to transfer a distribu- 
tion from N to M. Consider the following example. Let @ be the orthogonal 
group of degree n operating in the usual way on R”. Identify R with a sub- 
space of R” under the mapping t— (1,0,0,---,0) (GER). Let R, be the 
set of all positive real numbers. Now let Y=GXR, N the complement 
of the origin in R” and = the mapping (z,r)>ar (x€ G, re R,) of M 
onto N. Let f be a C” function on N which is invariant under G. Then 
f(zr) is independent of x. So in this way we get a function oy on R. D 
being a differential operator on N which is invariant under G, one can show 
that there exists a differential operator A(D) on R, such that opp == A (D)o; 
for any invariant C” function fon N. Theorem 1 enables us to prove similar 
results about distributions (see Theorems 2 and 3). 

The most significant result of this paper is contained in Theorem 4. This 
will be used in subsequent papers to prove the theorem about characters, 
mentioned above. 

The contents of this paper are as follows. In 82 we collect some well- 
known facts about manifolds, differential operators and distributions. §3 is 
devoted to the proof of Theorem 1, which, as we have just indicated, is rather 
basic for our purposes. In $5 we introduce invariant differential operators 
and distributions and consider some of their elementary properties. The 


* Received October 25, 1963. 
1I understand from Prof. L. Schwartz that he had independently obtained a similar 
result some years ago. 
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results of 87 are important for applications. They enable us to construct 
the above-mentioned mapping D>A(D). The main result concerning A(D) 
and the invariant functions, is proved in Lemma 10. In Theorems 2 and 8 
(of 89), this is extended to’ invariant distributions. This general theory is 
then applied to the case of a semisimple Lie algebra to prove Theorem 4. 
Our argument depends on a detailed consideration of some differential opera- 
_ tors associated with the Killing form (see Lemmas 30 and 31). 


Lemma 16 was pointed out to me by Borel who also gave me the proof 
of Lemma 17. These lemmas play an essential role in the proof of Theorem 4. 

This work was supported, in part, by a grant from the Sloan Foundation 
and a contract with the U. S. Army. 


2. Differential operators and distributions. By a manifold M we 
mean a Hausdorff and locally Euclidean’ space satisfying the second axiom of 
countability, all of whose connected components have the same dimension m 
` and are endowed with a C”? structure. It is oriented if each of its connected 
components is oriented. Let C” (M) denote the space of all O” functions 
from M to C and € the space of all C-linear mappings of C° (M) into itself. 
Then € is an associative algebra. If X is a (0°) vector-field on M and 
g€ C* (M), the mappings Er: f> Xf and Ep: fgf (fe O° (M)) are both 
in E Let D—-D(M) denote the subalgebra of € generated by Hx and E, 
for all X and g. Then D is called the algebra of differential operators on M. 
It would be convenient to denote Ex and FE, by X and g respectively. How- 
ever, if it is necessary to avoid confusion, we shall write the product of two 
differential operators Dı, Da as D10 Da. Thus ExEp = Xog while Fxg = Xg. 
If DeD and fe C”(M), we shall often denote the value of Df at a point 
pe M by f(p;D). | 

For any DED, SuppD is the closed subset of M defined as follows. 
Let pe M. Then p¢ Supp D if and only if p¢ Supp Df for every f € 0° (M). 
An indexed family {F'a},,, of sets in M is called scattered if, for every com- 
pact subset K of M, K N Fa==@ for all except a finite number of « in A. 
A subset © of D is scattered if the family {Supp D}peg is scattered. Let 
C° (M) denote the subspace of all functions in C*(M) whose support is 
compact. Put vp(f) —sup | Df| (DED) and for any scattered subset ® 
of D, define: vg(f) -2 vo(f) (f€0.” (M)). Let 9 be the class of all 


eo 
scattered subsets of D. Then the seminorms {vẹ;® € 8} define the structure 


‘of a locally convex space on C.” (M). The corresponding topology is called 
the Schwartz topology. K being any compact subset of M, let x” (M) denote 
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the subspace of all functions in C,~(M) whose support is contained in K. 
It is easy to see that the collections {vp; DED} and {vg;®€ S} define the 
same topology on Ox” (M). U being an open subset of M, any function in 
C,” (U) can be extended to a function on M by setting it zero outside U. 
In this way C,” (U) becomes a subspace of C,” (M) and it is easy to see that 
the injection 0, (U) > 0,” (M) is continuous. 

A distribution T on M is a continuous linear mapping of 0.” (M) 
into C. 

Leama 1. Let V be a complex locally conves space and T a linear 
mapping of Co” (M) into V. Assume that T is continuous on Oz” (M) for 
every compact subset K of M. Then T is continuous. 


This is an immediate consequence of Theorem II (p. 69) of [9]. 


Lemma 2. Let T bea linear mapping of C° (M) into C. Then it ts 
a distribution if and only tf it satisfies the following condition. Given any 
open and relatively compact subset U of M, we can choose a finite number 
of differential operators Da, > +, D, on M such that 

IPOS 2 sop | Df | (fE C.” (U)). 

This is well known and is an easy consequence of Lemma 1. 

Let M,, Af, be two manifolds and M, X M, their Cartesian product. For 
f€ Co? (Mi) (i= 1,2) let f, X fe denote the function (px, pa) > fa (p1) fo(p2) 
(PiE Mi; t= 1,2) on M, xX M, In this way we get a linear mapping of 
Co” (M) 80,” (Mz) into 0,” (M, X M,). , 

Lemara 3. The image of Co” (M) 80.” (M) under this mapping is 
dense in Ca” (M, X My). 

This is well known (see [9, p. 107, Theorem III]). 

It follows from Lemma 3 that given D,ED(M,) (i= 1,2), there exists 
exactly one differential operator D on M,X WH, such that D(fıX fa) 
= D;fı X Dafa (fi € Co? (Ma), i= 1,2). We denote D by D, X Da 


3. Proof of Theorem 1. Let w be a (C”) differential form on M of 
degree m. Fix a point pe M and let (z,,' ` `, 2m) be a coordinate system 
on some open and connected neighborhood U of p in M. Then there exists 
a unique function « € O” (U) such that o = æ dz, A dz, A: N dza on U. 
We say o50 at p if a(p) >£0. Moreover if M is oriented and w is real, 
we say w D> 0 at p if ea(p) >0. Here e= 1 or —1 according as the coordi- 
nate system (Tu ' ' ',Tm) is positive or negative with respect to the given 
orientation of M. We write œ > 0 if w is positive everywhere. 
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Now suppose » > 0. Then it defines a (positive) Borel measure u on* 
M. For example if f is a continuous function on M with compact support, 


we have 
fem ft 


Let H and N be two oriented manifolds of dimensions m and n respec- 
tively and r: M>N a surjective C” mapping such that rank dr = n every- 
where. 


TemoRem 12 Let wy and wy be two differential forms on M and N 
respectively of degree m and n. Assume that wy ts nowhere zero. Then for 
every a € Oo° (M), there exists a unique function fa€ C,” (N) such that 


(Fom)¢or—= $ Ffawy 
M N 


for all FEC,-(N). Moreover Supp fa C (Suppa) and a—>fa ts a con- 
tinuous mapping of C,” (M) into C,” (N). Finally if wu is nowhere zero, 
this mapping is surjective. 


COROLLARY 1: Let F be a continuous function on N. Then 


f, (fon) dow = J, Ffawy (ae 0,” (M)). 


COROLLARY 2. Assume wx >O, oy >0 and let py and py denote the 
corresponding Borel measures on M and N respectively. Suppose F is a 
Borel measurable function on N. Then F 4s locally summable (with respect 
to wy) tf and only tf For ts locally summable (with respect to pir) and, in 
case this is so, we have 


fi, (Por)a dus = f, Ffa duy (a€ 0,°(M)): 


Since wy is nowhere zero, the uniqueness of fa in Theorem 1 follows from 
its definition. Hence we are mainly concerned with its existence. We shall 
first prove Theorem 1 and its corollaries in a special case. 

For any a > 0, let I, denote the open interval (—a,a) in R and J, the 
closed interval [—a,a]. Let = denote the projection (21, * +, Em) > (Z1 °; En) 
of R* on R”. 


3 It is convenient to express this relationship by writing w-—~p, Similarly in other 
cages. 
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Lemma 4. For any a€ 0, (Ia”) define ga€ COo” (Io") by 
Jau(%,* * yn) = fa (tu + + Gm) Ems? ` * AEn 


Then aga is a continuous mapping of Oe” (I) onto Ce” (I,") and 
Supp ga C (Suppe). 


It is obvious that ge € 0° (Ia") and Suppga C a(Suppa). For any 
b (0<b<a), put 0r” (Is”) = Cx” (Is) where K—J,". Then it is easy 
to verify that the mapping is continuous on C,”(I,™). Therefore we con- 
clude from Lemma 1 that it is also continuous on C,*(I.™). So it only 
` remains to show that it is surjective. For this we may assume that m > n. 
Fix y€ 0," (I,"*) such that 


rl ye) Etna? dm. 


Then for a given BE C0.” (I,*), put a==8X y. Then a € 0" (I,") and 
B= Ja. l 

Now in Theorem 1 first consider the case when I = Ia”, N =I," and r 
is the above projection. Let 


dz = da, N dea N ++ A dtm and dy = dx, A dt: A’ AN dm. 


Then wy ==ya de and wy = yy dy where yx and yy are O° functions on M 
and N respectively and yy is nowhere zero. For any a€ C.” (M), define fa 
on N -as follows: 


fa = euevyy gyya 


Here ex, ey are constants equal to +1 chosen in such a way that ex de > 0 
on M and ey dy > 0 on N. Then fg obviously fulfills the condition of Theorem 
1. Moreover it follows from Lemma 4 that æ— fa is a continuous mapping 
of C.” (M) into C,” (N) and Suppfa Cr(Suppea). Now assume wy is 
nowhere zero. Then the endomorphisms «> yma. and g>yv'g of C.” (M) 
and C.” (N) respectively are surjective. Hence we conclude from Lemma 4 
that the mapping «— fa is surjective. Finally Corollaries 1 and 2 are, in 
this case, immediate consequences of Fubini’s Theorem. 

We come now to the general case. Fix a point pe M and choose a 
small open connected neighborhood U, of p in M. Let Vo =~r(Uo). Since 
rank dr—=n everywhere, V, is open in N and if U, is sufficiently small, we 
can choose a coordinate system (2#:,:-°*,%m) on U, such that (p) == 0 
(1SiSm) and 4——yjor (lSjSn) where (4:,- - -,¥xn) is a coordinate 
system on Vo. Fix a small number a > 0 and let U be the set of all ge U, where 
[a(g | <a (1&i& m). Ifa is sufficiently small, g— (2,(q);- ` -,%m(q)) 
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is a diffeomorphism of U with I”. Put V—r(U). Then it is clear from 
our discussion above that Theorem 1 and its corollaries hold for (U,V,7). 
This shows that for every p € M, we can choose an open neighborhood Uy of p 
in M such that Theorem 1 and its corollaries hold for (U,,r(U,);r). 
Fix a compact subset K of M. Then {U3} eg is an open covering of K 
_in M. We can therefore select a finite subcovering {U;}ısısr from it. Choose 
BE Co” (U4) such that B,+:-:+8,—=10n K. Put Vie=r(U,) and for 
‘any a € Ox? (M), define «== fia. Then a == a +: - -+ a, and a € 0." (Ui). 
Let fo, €C.” (V1) be the function which corresponds to œ; under Theorem 1 
for (Ui, Vyr). Put fe = PRE Then if F is a continuous function on N, 
i 


(For)aor— > oe 
..ı1siSr/M 


f ae f oe Í Phaps f a 
M U Yi; N 
‘from Corollary 1 applied to (Uy, Vẹọ r). Hence 


But 


Se O ar) Gear me 2 Í, Ffeay = f Ffany. 
Moreover Supp fa C y Suppfe, But Supp fae, C r(Supp a) C r(Supp a) 


since Theorem 1 holds for (Ui, Var). Hence Supp fe C ~ (Suppa) and the 
mapping @—> fa is continuous on Og” (M). Now assume wx is nowhere zero 
and fix g€ 0.” (N). Then we can select the compact set K above in such a 
way that Suppg Cr(K). Now {Vi}ısıer is an open covering for r(K) in N. 
Choose p € 0,” (9) such that p +p: +: °+Hpr=1 on a(E). Put gı = pg. 
Then g =g, -+' +9, Since Theorem 1 is applicable to (U, Va 7), we 
can choose € C,” (U) such that gi= fae, Then if a= a, +*+ an it 
` is obvious that g == fæ. This proves Theorem 1 and Corollary 1 above. 

Now we come to Corollary 2. Fix a point geN and a point pe M 
such that m(p) =q. Select Up as above and define Ve=x(U,). Then 
' Corollary 2 holds for (Up, V,m) and therefore For is locally summable on 
.V if and only if F is locally summable on Uy. Since g was any point of N, 
the first statement of Corollary 2 follows. Now assume that F is locally 
summable. Then if a €0,” (M), 


Í, (Pon) ad =X fon) ad 


-2 Sf Fastin J hada 
in the above notation. i . 
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We keep to the notation of Theorem 1. 


Leama 5. Let T bea distribution on N. Then the mapping r:«—> T(fa) 
(a€ O.” (M)) is a distribution on M. Moreover if. wx ts nowhere zero, T ts 
completely determined by r. 


The first assertion follows from the continuity of the mapping «— fe 
and the second from its surjectivity (when wa is nowhere zero). 


4. Adjoint of a differential operator. Assume that M is oriented and 
fix, once for all, a differential form w > 0. Then for every DED(M), there 
exists a unique differential operator D*, called the adjoint of D (with respect 


to w), such that 
idoma Dres 
Sr SF?" 


whenever f and & are two C” functions on Af, at least one of which has 
compact support. The mapping D— D* is an anti-automorphism of D(Af) 
of order 2. l 

Let & be the space of all distributions on M. Then we turn & into a 
D(M)-module as follows. If TeXand DED(M), the mapping f> T(D*f) 
(fe 0.” (M)) is a distribution which, by definition, is DT. Let a be the Borel 
measure on M corresponding to w (see §3). If F is a function on M which 
is locally summable (with respect to »), the mapping 


Tp: fo SI dp (fe 0.” (AL)) 


is a distribution. If we identify two locally summable functions whose 
difference is almost everywhere zero, then the mapping F—>Tr is injective. 
Let T be a distribution on M. Then we say that T is a function if T = Tp 
for some locally summable function F. In that case we also write T =F. 

If each connected component of M is endowed with an analytic structure, 
we say that M is an analytic manifold. Suppose M is analytic and D is a 
differential operator on M. Then D is analytic if for any analytic function f 
on an open subset U of M, the function Df is also analytic on U: Assume 
that the differential form w above is analytic. Then if D is analytic, so is 
also D*, 


5. Invariant differential operators and distributions. Let G be a 
group and M a manifold. Assume that @ operates on M. This means that 
for every g€ G, there is given a diffeomorphism >29 (xe M) of M such 
that atom a and (29) == as (9.9.6 G; reM). Let Q, denote the space 
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of all (0°) differential forms on M of degree r. Then G operates linearly on 
C° (M), D(M) and 9, as follows. Fixge@. Then 


Pate) (Fe 0 (I), 2€ M), 
Dee (DEDM),fEC-(M)), 
LEN) (we) 


where X,,---,X, are any r vector-fields on M. It is obvious that f-> f° 
(f€ 0,” (M)) is a continuous endomorphism of C,” (M). Therefore if T is ` 
a distribution on M, the mapping 79: f>T(f?") is also a distribution. 
In particular if » is a measure on M, the same holds for p9. 

Now assume M is oriented and we have fixed w as in $4. Let p» be the 
measure on M corresponding to w (see §3). Assume that wu for all 
g€ @ and fix DED(M). Then it is easy to verify that (D7)* — (D*)? and 
(DT)e=DsT? (gE G) for any distribution T on M. Let F be a locally ~ 
summable function on M. Then if T—F, it follows that T° == #9 where 
Fo ji is the function z> F(a) (ze M). 

A distribution 7 is called invariant, if T° =e T for all g €. G. Similarly 
a differential operator D is called invariant if D =D (g€ @). 

Actually, we shall mostly: be concerned with the case when G is a Lie 
group and the mapping (9,2) => of GXM into M is 0”. Let g be the 
Lie algebra of G.: Then for any X € g, we define a vector-field r(X)} on M 
as follows: - 


f(a37(X)) = {dfrr™ (2) /dt}i-0 (f€ 0” (M),zeM). 


It is easy to verify that [r(X),7(¥)]—7([X,¥]) (X,Y €g). A distribu- 
tion T on an open subset U of M is called locally invariant if (X) T = 0 for 
ali X€g. Similarly a differential operator D on U is said to be locally 
invariant if r(X)oD==Dor(X) for XE gq. 


LEMMA 6. 1(X)*=—r(Z) (XEg) and every invariant distribution 
(or diferential operator) on M is locally invariant. 


Fix 55€ Ce” (M). Then 


er Ste (g€ 0). 
Hence if Xeg, 


J DE bo— {(d/at) [Fog whee 
— {(d/at) Su fen. T Fr(Mpro. 
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This proves that r(X)*==-—+(X). Moreover it is easy to verify that 
tt (forex — f) > 1(X)f 


in 0,” (M) as t—>0. From this the assertion about an invariant distribution 
follows immediately. Let D be an invariant differential operator. Then if 
exp tX = z(t), we have 

(Df) — Df. 


Since D defines a continuous endomorphism of C,*(M), it is clear that 
| (X) (Df) = lim t*{ (Df)=® —Df} 
t>0 


= D(r(X)f). 
This proves that D is locally invariant. 


We now consider an example. Take M — G and define 27 = ga (g, € G) 
and let dz denote the left-invariant Haar measure on @ and w > 0 the corres- 
ponding left-invariant differential form. We write X’—=7(X) (X€g) in 
this case so that 


f(a; X’) = — {df (exptX- 2) /dt} 10 (fe 0* (Q),ze G). 


Lemma 7. Let T be a distribution on an open connected subset U of @. 
Suppose XT=0 for all Xeg. Then T ts a constant. 


Select a base X, © + ,X, for g over Rand put D=X’,?+4-- ++ X’,?. 
Then obviously D is an elliptic differential operator on G. Therefore since 
DT =Q, we can conclude that there exists a C” function F on U such that 
T = F. But then X’'F = 0 for all X ing. Since U is connected, this implies 
that F is a constant. 


6. Some notations and elementary facts. Let E be a vector space of 
finite dimension over an infinite field k and P(E) the algebra of all poly- 
nomial functions from E to k. Let E’ be the space of all linear functions 
on E. Define 8(#)==P(H’). We call S(#) and P(E) respectively the 
symmetric and polynomial algebras over E. Since E is the dual of K’, 
ECS(E). Let F be another finite-dimensional vector space over k and 
t: F> E a linear mapping. Then ¢ can be extended uniquely to a homo- 
morphism $(F)—S(E) which we still denote by #. If i is injective on F 
then it is also injective on S(F). In particular if F C E and ¢ is the inclusion 
mapping, we can identify $(F) under i with the subalgebra of S (F) generated 
by 1 and F. 


3 
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We denote by Ps(E) the space of all homogeneous polynomials on E of 
degree d. Similarly Sg(#)—Pa(H’). If FP CH, it is clear that $;(F) 
=S (F) N 8a(F). 

Now suppose E is the direct sum of two a E, Ea Let «, denote 
the projection of # on Æ; (1, 2) corresponding to the sum E = E, + Ee. 
Then given any polynomial function p on F, we can extend it to a polynomial 
function on E by setting p(X) =p(aqX) (XE H#H). This defines an isomor- 
phism of P(E,) into P(E) and we can identify P(E;) with its image by 
means of it. In this way P(E,) and P(E,) become subalgebras of E and it 
is obvious that the mapping (Pı, Pz) > pipe (mE P(E,) defines an isomor- 
phism of P(E,)®P(E,) onto P(E). 

Let A be an automorphism of E. Then A can be extended uniquely to 
an antomorphism qg—g4 of S(#). Moreover, for any pE P(E), define p4 
to be the function X>p(A"X) (XEE). Then p— p4 is an automorphism 
of P(E). 


7. The radial component. Assume k has characteristic zero and let 
g be a Lie algebra over k. For any X€ g let Lx denote the endomorphism 
of S(g) corresponding to multiplication by X in S(g). Also let dr denote 
the unique derivation of 8({g) which coincides on g with adX. It is imme- 
diate that driy— Lydy—L,x,y). For Yeg, put* 


oy (X) = Lix, yı + dx (X Eg). 


One checks without difficulty that cy is a representation of g on S(g). Let 
© be the universal enveloping algebra of g. We can extend oy (uniquely) 
to a representation of © which we again denote by oy. Define a linear mapping 
Ty of ©@S(g) into S(g), given by 


Tr(g8 p) =o (9)p (gE ©, p€ S(q)). 


Let à denote the canonical mapping of S (g) onto © (see [4(a), p. 192]). 
For any linear subspace U of g, define Ga (U) —A(34(U), S(U)) =A 8 (0)) 
and ©, (U) Mm). It is obvious that for a fixed F €g, Ty defines a 


linear mapping of Sa (8) ®Sa(q) into E Salg). 
0Sd54;+dy 


Fix an element X, € g and let 3x, denote the centralizer of X, in g. Put 
gx = [Xo g] and choose linear subspaces U and V in g such that 


g = U + 8x = Y + ax 


* Cf. [4(d), 85], [4(c), §3] and [1, §2]. 
“CE. re [4(c)]. 
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where both sums are direct. For any u€ U, consider the linear mapping 
pu: (0,9) > w+ [X +u] (we U,ve V) 


of U X V into g. It follows from the definition of U and V that ¢, is bijective. 
Let €(g) be the space of all endomorphisms of g and J the identity mapping 
of g. Since 

pu (w, v) = po (9, v) + [u,v] (u,weU;veV), 


it is clear that 
U—> dado t —I 


is a linear mapping of U into €(g). Put 
g(u) = det (pupo) (we U). 
Then ge P(U) and g(0) =1. 


Lemma 8.5 Let u be an element in U such that q(u) 0. Then Trou 
defines a bijective linear mapping of S(V)®S(U) onto S(g). 


We prove by induction on d= 0 that 
D Vrouw (Se,(V) @ 8a,(0)) = È 8-(g). 
dytdycad rSda 


If d= 0, this is obvious. So assume d>1. Obviously the left side is con- 
tained in the right side. Hence in view of our induction hypothesis, it is 
enough to prove that 


E Trou (Sa (V) @ Sa(7)) + 2a D Sale) 
Ardzäd 
where 3, = 2 8:(9). Now q(u) z£0 and therefore 
8 
g = pupo “g = U + [Xo +u, Vi. 
Hence Sa(g) is spanned by elements a of the form 
a= I] w I [Atu] 


isish 15/8 


where w, € U, yE V and dı + dz == d. Put g= (— 1) 0w: + 04) E Sa,(V) 
and p= WW: ` -Wwa €E Sa (U). Then 


Truul(g D p) =ozu(g)p=amod dga. 
This proves our assertion. 


E Cf. Lemma 4 of [4(c) ]. 


22.288 HARISH-OHANDRA. 


Now since ¢, is bijective, dim g = dim U -+ dim V. Therefore the spaces 

and > S,(V)®8,(T) have the same dimension. This proves that 
dtdd 

Tus is injective. 

Let A and B be two vector spaces over k and suppose dim A <œ. Then 
p: A>B is called a polynomial mapping if the subspace B, of B spanned 
by p(A), has finite dimension and p, viewed as a mapping of A into B,, is a 
polynomial mapping in the usual sense. 

Lemma 9° Fis an element pe S8(q). Then there exists an integer 
r= 0 and a polynomial mapping yp: U >S(V)O8(U) such that 


Txos (yp (u)) = 9 (u)*p 
for ve. 


Fix an integer d= 0 and let 


M= 2 Ga, (V) 88,(U) 
dtd 


and let T(w) denote the restriction Tr, on Wa We have seen that 
dim Wa == dim ds. Fix a bijective linear mapping C of 34 onto Wa and put 
A(u) =CI(u). Then it is obvious that u— A (u) is a polynomial mapping 
of U into the space €(W4) of all endomorphisms of Wy. Let Q(u) == det A(u). 
Then it follows from the proof of Lemma 8 that Q (u) = 0 implies ¢(u) — 0 
(uc U). Let & be the algebraic closure of k, g—g@,k and Ü, V the sub- 
spaces of g spanned by U and V respectively. We can regard Q and q as 
polynomial functions on U. By applying the above reasoning to g, U, 7 
instead of g, U, V, we deduce that Q (ù) 40 unless g(E) —0 (GE Ü). Since 
k is algebraically closed, this implies that Q divides q" in P(Ü) (and therefore 
also in P(U)) for some integer r = 0. 
Now let N == dim W, and t an indeterminate. Then 
det(t—A(u)) = (—1)%Q(u) +t I Qulu) (ue U) 
18j3N 
‘where Q;€P(U). Put 


B(u) = (—1)¥* $ Q,(u)A(u) 
1j3N 
Then B is a polynomial mapping of U into €(Wa) and 
A(u)B(u) = B(u)A(u) =Q (u)I 


* Cf. Lemma 5 of [4(c) ]. 
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where J is the identity mapping of Wa. 
We can assume that d is so large that p€ ĝa. Then 
Trsa (B(u) Cp) = O74 (u)B(u) Cp — Q(u) p. 
But q" — Qq, (qa € P(U)), as we saw above. Put 


yo(u) = qi (u)B(u) Cp. 
Then 


Txuu(yp(u)) = g(u)"p (uc U). ` 


Let U’ be the set of all points ue U where q(u) +40. Then 0€ U’ 
since g(0)—=1. For any pE S(g), let 8,(w) denote the unique element in 
©(V)@S(U) such that p == Lr uu(8p(u)) (uc U’). Moreover let a,(p) 
denote the unique element in S(U) such that 


Bp(u) — (18 au (p)) €S. (7) 9 8 (U) (ue U’). 


We shall call a,(p) the radical component? of p at u (with respect to Xo, 
U, VY). 


Remark. It is obvious from the proof of Lemma 8 that if pe S,(g) 
then „(p)E X 8,(U) for we U’. 
0SrsSd 


8. The mapping A. Let g be a Lie algebra over R and fix an element 
X ing. Select U and V as in $7 so that g—U-+qx,—V+taz, Let go 
denote the complexification of g and U, Ve the subspaces of ge spanned by 
U, V respectively. Now we take k—C in §7 and denote by © the universal 
enveloping algebra of g.. As before, U’ is the set of all points u€ U where 
q{u) 40 (see Lemma 8). 

g, being a real Euclidean space, is a manifold. For any p& S(g.), we 
define, as usual (see [4(c),§2] the differential operator @(p) on g. Let D 
be a differential operator on an open subset of g. Then we define a 
differential operator A(D) on the open subset U’ N (Q— X.) of the Euclidean 
space U as follows. As usual let Dy denote the local expression of Dat Yea 
(see [4(c), p. 90]). Fix we U’N (Q—X,) and choose pu € S(g.) such that‘ 
Dyyu=O(py). Then l 

A, (D) =ô (au (pu) ). 


Here A(D) is the local expression of A(D) at u and a,(p,) is the radial 
component of p, at u (see $7). Lemma 9 ensures that this does, indeed, 
define a differential operator on U’N (Q—X,). 

For any X € g, define a vector field r(X) (cf. 85) on g by 
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{(Y57(X)) = — {df (exp (tad X) F) /dt} tza 
=—— f (Y ;0([X,Y])) (fec (8), Y €g). 


Tt is easy to verify that [r(X),r(F)]J—r([X,Y]) for X, Yeg. Hence r 
“can be extended uniquely to a a of & into the algebra of all 
differential operators on g. 

. A C” function f on an open subset © of g is called locally invariant if 
+(X)f—0 for all Y€g. The significance of A(D) is given by the following 
result (cf. [4(c), Lemma 6]). 

Lemma 10. Fic a point u€ U’ and let f be a locally invariant O° 
function on an open neighborhood Q of Xo+ to in g. Then if D ts any 
differential operator on Q, 


f(X + to; D) = f (Xo + %0; A(D)). 
Choose pE S(go) such that Dram =ô (p). Then Aw (D) =d(au(p))- 
Hence it is enough to prove that 
f(Xo+W;8(p)) =f (Xo + %050(au(P))) 
for pE 8 (go). 


Let @ be a Lie group with Lie algebra g. Then @ operates on g as 
follows: X° = Ad (<) X (ze G, X €g). We sometimes also write sX for X®. 
As usual (see [4(d),§4]), we regard elements of @ as left-invariant differ- 
ential operators on G. Select open neighborhoods G, and Q, of 1 and X, + wo 
in G and Q respectively, such that Q,% C 2. Put F(s: X)—F(zX) (ze Go, 
KEN.) for any FE C*(Q). Then we know [4(c), Lemma 3] that 

F(z3g:X30(p)) =F(2:X;3 (ex (g)p)) = F(a: X30(Ux(g@p))) 


for g E ©, pE S (ge). l 
The mapping ¥ > — X of g, can be extended uniquely to an anti-auto- 
morphism of © which we denote by *. 


Lema 11. Let FEC"(Q). Then 
F(2;9:X) =F(2:X;r(g*)) 
for zE Go, X EQ, and ge G. 
Let Y.,---,¥,€g. Then 
{OF (z exp tF,’ - -expt,F,:X)/Ot + + + Oty} ye-ct,-0 
= {OF (x: (exp h Yı’ - -expt-F,)X)/Oty- Ölen 
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` 


for z€ G, and XEQ,. Lemma 11 follows immediately from this fact. 


Now we return to Lemma 10. Fix p€ S(g.). Then, from Lemma 9, 
we can choose HE ©.(Vo), HE S(Uc), GE P(U.) GSLSN) and an 
integer r = 0 such that 


p= a(p) tgu)" E gyltu) xag p) 
. 154,35N 
for u€ U’. Therefore 


f(Xo+u50(p)) =f (Xo + 4; 8 (en(p))) 
+ uw" qulu)f (13 gs: Xo + 45; 4(p,)) 


for we U’ N (Q—X,). But gı and therefore also g,*, are in ©,(V.). Hence 


ie: Zot u) =f (Xo+ u;r(g*)) = 0 
as f is locally invariant. Therefore 


F(13 gi: Xo +u; p)) =0 SLIS N) 
and so 


f(Xo+u34(p)) =f (Xa +u; (a(p))) 
for u€ U’ N (Q—X,). This proves Lemma 10. 


9. Application to invariant distributions. From now on we shall 
assume that G is unimodular. Then g is also unimodular, i.e. tradX == 0 
for X€g. Let dX denote the Euclidean measure on g and de the Haar 
measure on @ (both normalized in some fixed but arbitrary way). Then de 
is both left- and right-invariant and dX is invariant under G. Fix an 
orientation of g and let wy be the positive differential form on g of degree 
n= dimg, such that? wy~dX. Similarly let w@0 be a real and left- 
invariant differential form on G of degree n. We can orient G in such a way 
that wa > 0. Moreover we may assume that wa~ dz. 

Now take Mg and w == wg in the set up of $5. Then the definitions 
of 7(X) (X €g) of Sections 5 and 8 actually coincide and we conclude from 
Lemma 6 that r(g*) =7(g)* (ge ©). Moreover g* is the adjoint of the 
differential operator g on @, with respect to wg. 


Lemma 12. Let w denote the mapping (z,u)—>s(X, +u) of GXU 
into g. Then rank dr =n everywhere on GX U’. 


Fix a point (z,u) in ŒX U’. Since the tangent space at any point of 
a Euclidean space E can be canonically identified with F, the tangent space 
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of GXU at (z,u) is g X U. Similarly the tangent space of g at Y— (X, + u) 
is g. Let f¢C*(g). Then 


{(d/dt) fm (2 exp tX,u)) Jeo f(¥30([X, Xo + u]e)) 
‘for Xe g and 
{ (d/dt) f (r (z, u + tw)) }tco = f(¥ 5 8(w*) ) 
for we U. Hence 
. (dr) ou(X,w) = ([X, Zo +u] +w)" 
and therefore if v€ V, w€ U, it is clear that 
(der) (0,0) = (by (w, — v) )? 


in the notation of §7. But since u€ U’, dy is a bijective mapping of U X V 
onto g. This proves that (dr)., maps V X U onto g*==g and therefore 
rank (dr)a,u =n. 

Fix an orientation of U and let wy > 0 denote a differential form on U 
such that wg~ du, where du is a Euclidean measure on U. Now take 
M—-GXU, N=r(GX U’), vu~ dedu, wy ~dX. Then the following 
result is an immediate consequence of Theorem i and Lemma 12. 


Lemma 13. Put Q =r(@ X U’) = (X, +U’)® Then Q is open in g 
and for every a€ C,” (ŒX U’), there extsts a unique element fa€ 0. (Q) 
such that 


J ECZ +W)ata: udedu= f FDA 


for every FEC.” (Q). The mapping a—>fa of 0 (AX U’) into 0.” (Q) 
is continuous and surjective and Supp fa C r (Suppa). 
Coronary 1. Let F bea locally summable function on O. Then the 
function (x,u) >F(z(X,-+-u)) is locally summable on GX U’ and 
f Fiz(X,+u))a(z: u)dedu— f F(X)fa(X)dX 
exw” a 


for every a€ 0.” (GX U’). 
This follows from Corollary 2 of Theorem 1. 


COROLLARY 2. Let Qo be an open subset of Q and T a distribution on 
Qo. Select open subsets Gy, U, of Q and U’ respectively such that (Ga X Uo) 
Co Then the mapping 
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or: «> T (fa) (a€ Co” (Go X Uo)) 


is a distribution on Go U. Moreover or ==0 implies that T=0 on 
(Go X Up). l 
This follows by taking M = G, X U, and N =r (G X Uo) in Lemma 5. 
For any X €g, define the vector field X’ on G as in Lemma 7. We 
denote the differential operator X’ on G as in Lemma 7. We denote the 
differential operator X’ X 1 on GX JU also by X”. 


Lumma 14. fra==rt(X)fe for X€ g and a€ 0 (GX VU’). 
Fix a Then for any F € 0.” (Q), 
SF(z(X, +u))a(yz: u)da du 
= (F(y!s(Ko+u))a(e: u) da du 
— (Fv(z(X,+u))a(z: u) da du 
om f FU(X)fa(X) dX 
= (F(X) fat? (X) dX 
if y is sufficiently near 1 in G. Now for a given FEg, put „=exptY 
(GER). Then it is clear that 
— fF(z(X,+v))a(e;Y’: u)ds du 
== ((d/dt) SFla(Xo+u))alyız: u) de du) 
= {(d/dt) f F(X) fav (X) dX} 4-0 
= — fP(X) fa(X 57(¥)) aX. 
This proves that fre—=7(Y) fa. 


THEOREM 2. Let Ge and U, be open subsets of G and U’ respectively. 
Assume that G is connected and not empty. Then if T is a locally invariant 
distribution on Qo==1(Gy X Uo), there exists a unique distribution or on 
U, such that 


T (fe) = or (Be) (a € Co (Go X Uo) ) 
where Ba is the function in O,” (Uo) given by 
Ba(u) = falr: u)de (we Uo). 
Moreover op ==0 implies that T =Q. 


Define the distribution or’ on Go X U, as in Corollary 2 of Lemma 13. 
Fix X€g. Then, as we have seen above, X’ is a vector-field on GXU. 
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k We claim X’or’—=0. Since dz is left-invariant, (X’)* =-— X’ and therefore 
‘we have to prove that or’ (X’a) —0 for a€ 0.” (X Uo). Fix a. Then 
ar’ (Z'a) —=T(fre) =T(r(X)fe) = 0 
- from Lemma 6, since T is locally invariant. 
Fix an element £ € 0,*(U,) and consider the mapping 
Sp: yor’ (y XB) (yE 0° (G@o)). 
Then Sg is a distribution on @, and it is obvious from the above result that 
X’Sg==0 (X€g). Therefore from Lemma 7, there exists a complex number 
C(g) such that 
Sp(y) —C(B) fy de (yE Co” (@)). 
‘Now fix yo€ C.” (Go) such that fyodr=1. Then 
C(B) = Selyo) =r’ (yo X B). 


The mapping Bor’ (yo X £) (8€ C.” (U.)) is obviously a distribution on 
` Ua which we call or. Then 


or (y X 8) =or(8) fy de (y € Co? (Go), BE Co” (Ua) ). 


Now for any a € C.” (Go X Uo) define Ba as in the statement of Theorem 2. 
Then the mapping o: a — or(a) is obviously a distribution on @, X U, and 
ox (y X B) =o(y XB) for BEC” (Uo), yE C.” (Go). Hence we conclude 
from Lemma 3 that or ==0. This proves that 
T (fa) = or (a) = or (Ba) (@€ Co” (Go X Uo). 
Moreover for a given SEO," (Uo), set a =y Xf. Then B=fe. This 
shows that the mapping æ — Ba of Co” (Go X Uo) into C.” (Uo) is surjective. 
Hence the uniqueness of or in Theorem 2 is obvious. Finally suppose or = 0. 
Then or (a) =or(ßa) =0 (€ C,”,G) X U,)) and therefore or’ = 0. But, 
as we have seen (Corollary 2 of Lemma 13), this implies that T == 0. 
We keep to the notation of Theorem 2. 


THEOREM 3.’ Assume further that 1€ Go. Then if D is a differential 
operator and T a distribution on Q, and they are both locally invariant, we 
have ODT = A(D)or. 


We observe that DT is also locally invariant and therefore epr is defined. 
Moreover U, C Qo— X, and therefore A(D) is defined on Us. Theorems 2 


1 This can be considered as a generalization of Lemma 10 to distributions. 
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` and 3 provide the main justification for the consideration of the differential . a 


operator A (D). 


_ COROLLARY. Let Dı, D: be two diferential operators and T a distribu- ; 
tion on Qo. Suppose all three of them are locally invariant. Then Er 


A(D,D,)or—A(D,)A(D,)er. 


This an immediate consequence of Theorem 3. 
_ The proof of Theorem 3 requires some preparation. 


Lemma 15. Let D be a locally invariant differential operator on an 
open set Q in g. Fis an element X EQ and an open connected neighborhood 
Gy of 1 in G such that yX €Q for all y€ Go. Then 


Dyx == (Dx)* (ye Go). , 


For any s€ G, let p—> p° (pe S(g.) denote the unique automorphism 
of S (go) which coincides with Ad(z) on ge. In this way G operates on S (go) 
and it is obvious that for any d= 0, the space Sg(g.) is stable under G. 
Hence for a given p in S (go), the elements p” (xE G) span a finite-dimensional 
space V. The corresponding representation on V being obviously continuous, 
it follows, from the theory of Lie groups, that it is analytic. It is easy to 
verify that {dp™P!¥/dt},.0—dyp (Y €g). Moreover it is clear that d(Y*) 
= (H(K))* (Peg,ze@) and therefore 4(p*) = (8(p))* (pE 8(g)). 

We can choose € 9(go) and qE C” (A) (1Si<r) such that 


Dom Z (m. 


Moreover we may obviously assume that p,,- - -,p, are linearly independent 

over C and the subspace of S(g.) spanned by them is stable under G. Let 

pe = DS pealt) (1SiSr,zEe@) where cy are analytic functions on G. 
j 


Let C(x) denote the matrix (cy(2))ıs,w. Then s—> O(s) is a matrix 
representation of G. Let Y—>C(Y) (Y €g) denote the corresponding repre- 
sentation of g and y(F) (1S4,j=r) the coefficients of the matrix 0 (FY). 
Put gi(y) =Z ulyuy) (yE Go). Then if Y€g, 
— (9; 77) = {dg (exp tY - y) /dt}iz0 
eh) + 2 ca (¥) ax (yX)}. 


We claim that if a€ C” (Q) and pe S(g.), 


r(Y) 0a—aor(Y) =7(F)a, 
r(F) 06(p) —A(p) or(¥) =ô (drp). 
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The first assertion is obvious since +(Y) is a vector field. The second is seen 
as follows. Let f€ C” (g). Then 


r(Y) (8(p)f) = {d(8(p) f)*/dt} 120 
where y,==exptY. But (d(p)f)Y =d(prı)fvr and therefore 
t(Y) (8(p)f) —8(dyp)f + 8(p) (Pf). 
Now since D is locally invariant, we have 
0=r(F)oD—Dor(F) = (r (¥)u) (p) + að (dypi) }. 

But dry X pycu(Y). Hence 

© DEut Z alP)a)ap) 0. 
From this it is clear that 

IR 


But this obviously implies that g;(y;¥’) 0. Since @, is connected, this 
shows that g; is a constant. Hence 


ghy) = 9 (1) = 4,(X). 


Therefore 
(X) = Beu(y*)ay(yX) 
or 
a (y) =X oy(y) a5(X) (YEG). 
But then 


(Dz)! = 2: a4 (X) 0 (p) =Z en(y)n(X)9 (By) 
= 2 a(yX)ö(p;) = Dyx. 
This proves Lemma 15. 


Now we come to the proof of Theorem 3. Fix ae Co” (Go X Ua) and 
FEC,” (2o). Then 


SED*fa dX = f DF -fa dX = (F(a(X,+u);D)a(e: u)dedu 
from the definition of fe. But 
F(a(X +u); D) = F (2 (Xo +u); Dotzou) 


= F (s (Xo +u); (Druw)®) (2E Go, u€ Uo): 
from Lemma 15. However 
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F(z(X,-+ u) > (Dxgsu)®) —=F(z: Xo+ u; Dr) 


in the notation of Lemma 11. Moreover we know (see the proof of Lemma 
10) that there exist elements g€ S,(Vo), pmES(U.) and a,€ C* (Us) 
(1Si5r) such that 


Diu—=&a(D)+ © vun (Hp )) (u€ Up). 
1stsr 
Hence 


F(a: Xo+ u; Dr) 
= F(z: X,+u;A(D)) + Bau) Ph (z; g: Xo +; 8(pi)) 
for ze G and u€ Uy. Put 


oy (a: u) =ala;g*: u50 (p)* Oa), seien) 
G(x: u) =a(z: u;A(D)*), 


where, as usual, * denotes adjoint. Then 
SFD*fadX—= 3 fF(x(X.+u))a(e: u) de du 
0SiSr 


= DS [Fi dX. 
Siar 


D*fa = 2; fa, 
ostSr 


This shows that 


and therefore 
T(D*fa) = % or(Ba:) 
Sir 


from Theorem 2. However g; and therefore also g,*, are in ©,(V.). Hence 
falz; gi: u)de—0 (u€ Up) 


from the right-invariance of the measure de. This shows that Ba,<=0 for 
41221. Moreover it is obvious that Bau,=A(D)*Bq. Therefore 


T(D*fa) =or(A(D)*Be) 


and so we can conclude from Theorem 2 that opr=A(D)or. This completes 
the proof of Theorem 3. 


10. Statement of Theorem 4. Now we intend to apply the results of 
§ 9 to prove a theorem about distributions on a semisimple Lie algebra. So 
let us assume that g is semisimple and @ is connected. Identify ge with its 
dual, by means of the bilinear form B(X,Y) —tr(ad X ad Y) (X,Y € gə). 
In view of the invariance of B under G, this identification is compatible with 
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the action of G. Thus elements of S (go) become polynomial functions on go. 
Let I(g.) denote the subalgebra of all invariants of G in 8(g.). It is easy 
to see that I(g.) is the set of all pe S(g.) such that drp—=0 for all 
Xeg. By the Killing form (of g), we mean the polynomial function 
wo: X—>tr(adX)?(XE g.). If 6 is any automorphism of ge, it is clear that 
ad(6X) —=H(adX)9 and therefore «(6X) ee) (X€g.). Hence, in 
particular, w € F (go). 

An element X € go is called nilpotent if ad X is nilpotent. Let N denote 
the set of all nilpotent elements of g. 


Turorem 4. Let T bea distribution on an open subset Q of g. Assume 
that 

1) T is locally invariant, 

2) Supp7TcHNA, 

3) G(o)T—0, where w ts the Killing form of g. 
Then T ==0. | 


The proof of this theorem is rather long and requires considerable prepara- 
tion. It is obvious that Ne= (re G). Hence G operates on N. 


Lemma 16. N is the union of a finite number of G-orbits. 


This follows from a result of Kostant (Corollary 3.7 and Lemma 5.1 
of [6]) and Proposition 2.3 of [2]. 

Let N, denote the union of all G-orbits in N of topological dimension 
Sq. Also put N= Ø and let N, denote the complement of N, in. 


Lemma 17. N, ts closed in N and tf X.ENGN°Nger, then XS is 
open in N. (¢=0). 


This is an easy consequence of the theory of algebraic groups. We shall 
give a proof (which is due to Borel) in § 18. 


CoROLLARY. For any KEN, the orbit X,@ is locally compact. 


_ Let q be the topological dimension of X,%. Then X,@ is open in the 
closed subset Ng of N. Since N is obviously closed in g, N, is locally 
compact and our assertion follows. : 

Fix X,€ N and let Z(X,) denote the centralizer of XY, in G. Then Z(X,) 
is a closed subgroup of G. Let z—>x* denote the natural mapping of G on 
G* == G@/Z(X,) and define X, = X" 2X. 


Lemma 18. 2%» 2*X, is a homeomorphism of G* on X,°. 
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This follows from a theorem of Arens (see 1 p- 65]), if we take the 
corollary of Lemma 17 into account. 
Let gx, denote, as before, the centralizer of x, in g. 


COROLLARY. Let q be the topological dimension of X,°. Then 
q = dim G— dim Z(X,) = dim g — dim gx,. 


This is obvious from Lemma 18. 
We observe that in order to prove Theorem 4 it would be sufficient to 
obtain the following result. 


Lexma 19. Fix an integer q=0 and let T be a locally invariant dis- 
tribution on an open subset Q of g such that d(o)T—=0 and SuppT C NINAR. 
Then SuppT CNN O. 


11. Some elementary facts about distributions. Let # be a finite- 
dimensional vector space over R and E, its complexification. Fix a point 
X,€ E and let 8x, denote the distribution 8x,: F>f(X,) (FE C.” (E)) on E. 


Leasa 20. Let o be a distribution on an open neighborhood U of X, 
in E and suppose Suppo C {Xo}. Then there extsis a unique p€ S(E.) 
such that? o=4(p)6x,. 


This is a well-known and elementary result (see [9, Theorem 35, p. 99]). 


Lemma 21. Let o be a distribution on an open set U in E and X, a 
point in U. Let n be a function in C°(U) such that n(X)—=0 for every 
X € Suppo. Then there exists an integer k= 0 such that X,¢ Supp (Fo). 

Fix an open neighborhood V of X, in U such that V is relatively compact 
in U. Let X1,:- +, Xn be a base for E over R and let Fm denote the set of all 
monomials X," --X,"™¢€ S(H,) with m+: Hmm. If D is any 
differential operator on U, we can choose m>0 and a,€ C*(U)(pe Fm) 
such that 


D= $, 4,4(p). 
Pern 
Hence if fe C.” (V), it is clear that 
| Df | = cmaxsup | d(p)f | 
3 DEFm 
wh C= ; 
ere PN sup | a | 


° Here the adjoint is defined with respect to the Euclidean measure on F. 
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Now, from Lemma 2, we can choose differential operators Di “+, Dy 
on U such that 
lo(f)|S 2 sup| Dif} . (fee (P)). 
1Sj3N 


Hence it is obvious that we can choose an integer m= 0 and a number b = 0 
such that 


| o(f)| Sb max sup | O(p)F | (f€ C” (V)). 


First assume that 7 is a real-valued function. Fix fe 0,” (V) and for 

any ac C.” (R), define 
7,(a) =o(a{m)f) 

where a(7) denotes the function Z>a(n(X)) on U. Then zy is obviously 
a distribution on R. We claim Suppr,; C {0}. For suppose 0¢ Suppa. 
Then if X € Supp(a(n)f), it is clear that „(X) € Suppa and Xe V. Hence 
n(X) 40 and therefore, in view of our hypothesis, X¢ Suppo. This shows 
that Supp (a(n)f) N Suppo — Ø and therefore r;(a@) = 0(a(y)f) —0. Hence 
Supp ty C {0}. 

On the other hand 

Il) =] o(a(n)f)| rm | 8(p) (a(m)f) | 


< cmax sup | d’a/dt | 
0Sr3m 
where c is a positive number independent of « and £ is the coordinate variable 


on R. Therefore (see [9, pp. 99-100]) we can choose complex numbers 
e (f) (0SrSm) such that 


r(a)= È af) (dra/dir), (a € 0o” (R)), 
Sram 
where (d’a/di"), is the value of dra/dtr at t=0. Put a=" for any 
BEO-(R). Then (dra/dt")o=0 (0Sr<m) and therefore 
O=o(a(n)f) =o (78 (n)f). 


Since V is relatively compact in U, we can choose a compact set J in R 
such that (V) CJ. Choose BE C,” (R) such that 8==1 on J. Then if 
XET, B(n(X)) 1 and therefore 8(y)f—=f. Hence 


ef) elf) =0. 
This proves that 7¢-=0 on V. 


Now we come to the general case. Let = yg- V—171 where ne and 
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nr are real-valued functions on U. Then by the above result, we can choose 
an integer 1> 0 such that X, ¢ Supp ng'o, Xo¢ Supp y's. Therefore 


qtto m= (qr + V—1m)"o—0 
around X,. This completes the proof. 


12. First step in the proof of Theorem 4 We now return to the proof 
of Lemma 19. First assume g—0. Then if X,€ No, it follows from the 
corollary of Lemma 18 that g== x, Since g is semisimple, this implies that 
X,—=0. Therefore N, = {0} and so if 0 ¢ Q, it is clear that Supp T = Ø 
and hence T ==0. So let us assume that 0€EQ. Then T —=A@(p)8 for some 
pe 8(g.), by Lemma 20, But @(0)T 0 and therefore @(wp)8)—0. This, 
however, implies, again by Lemma 20, that op—0. Since S(g.) is obviously 
an integral domain, we get p= 0 and therefore T—=8(p)8)—0. 

So we can now assume that g>1. Fix an element X, € Ng N Nes. 
Then we have to prove that X,g SuppT. Choose U and V as in §8 and 
use the notation of §9. Then 0€ U’. 


LEMMA 22. We can choose an open neighborhood U, of zero in U’ 
with the following property. Let x be an element in G. Then cX, — Xs ¢ Uo 
unless TX = Xo. 


I give here an improved version of my original proof, which was sug- 
gested by Kneser. It follows from Lemma 18 that 2*—x*X, is a univalent 
and regular analytic mapping of @* into g. Hence X,@ can be regarded as 
an analytic submanifold of g (see [8(a), p. 85]). Its tangent space at X, 
is obviously gx, On the other hand X,-H U is an affine variety in g, whose 
tangent space at X, is U. Since gx, N U — {0}, X,@ and X,+ U are trans- 
versal at Xo. Therefore we can choose an open neighborhood G,* of 1* in 
G* such that &*X,N (X, + U) = {Z,}. On the other hand, by Lemma 18, 
there exists an open neighborhood go of X, in g such that G)*X)—= go N Xo". 
Now select an open neighborhood U, of zero in U’ such that X, -+ Uo C go 
Then ~ 


Xf N (X, + Uo) C Gy*Xo N (Xo + U) = {Xo}. 
This proves the lemma. 


In order to prove that X, ¢ Supp T, we may obviously assume that X, € ©. 
By Lemma 17, X,@ is open in Na. Hence we can choose an open neighbor- 
hood Q, of X, in Q such that R, N Na CXS. Let G be an open connected 
neighborhood of 1 in G. We can assume that G, and U, (as defined in 


4 
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Lemma 22) are s0 small that (Go X Uo) CRo (Here w has the same 

meaning as in §9.) Define the distribution er on U, as in Theorem 2. 
Lemma 23. Suppor C {0}. 


Fix B€C,*(U,) such that 0¢ Suppf. Then we have to show that 
or(B) = 0. Choose yE C.” (Go) such that fyde—1 and put a= yX £. 
Then o7(8) =T(fa). But we know that Supp fa Cw(Supp«). Hence if 
X € Supp fa, we have K=z(X,+u) for some sE Suppy and u€ Supp £. 
We claim x ¢ XS. For otherwise X—yX, for some y€ G. Therefore 
Xo + u= 2X, where z=r"y. Hence umzX,—X,€ Uy. But us£0 since 
u€ Suppß. So we get a contradiction with the definition of U, (see Lemma 
22). This shows that Supp fa N X, == Ø. However 


Supp T N Supp fe C Na N Qo C XS. 
Therefore Supp T n Supp fa = Ø and so T (fe) =0. This proves the lemma. 


COROLLARY. There exists a unique element ze S(U,) such that 


`or(ß) =8(0;8(z)) 
for all BE C,* (Uo). 


This is an immediate consequence of Lemma 20. 


Remark. In order to prove that X ¢ Supp T, it would, in view of 
Theorem 2, be enough to show that or—=0. Hence it would be sufficient to 
establish that z == 0 in the above corollary. 


18. Theorems of Jacobson-Morosow and Mostow. In this section we 
recall some known facts about semisimple Lie algebras. 


Lemma 24 (Jacobson-Morosow). Let g be a semisimple Lie algebra 
over a field k of characteristic zero. If X340 is any nilpotent element in g, 
we can choose two elements H, Y € g such that 


[H,X]=—=2X, [H,Y]—=—2Y, [X,Y]=—d. 
For a proof see [5, p. 108, Theorem 3]. 


Lemma 25. Let I be a three dimensional Lie algebra over k spanned 
by three elements H, X, Y with the relations 


[H,X]=2X, [H,Y¥]=—e2Y, [XZ,Y]=H. 


Then | is semisimple. Let p be a representation of I on a finite-dimensional 
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vector space V. Then 1) p is fully reducible, 2) p(X), p(Y) are nilpotent, 
3) p(H) is semisimple and all its eigenvalues are rational integers. Now 
suppose V is irreducible and dim V =m 4-1 (mZ 0). Then the eigenvalues 
of p(H) are m—2r (Or m) and each of them has multiplicity 1. Let 
Vm be the subspace of V corresponding to the eigenvalue m. Then Vin 18 also 
the space of all vE V such that p(X)v—0. Finally p is absolutely irreducible 
and, apart from equivalence, there is exactly one irreducible representation 
of I of degree d for any integer d= 1. 


All this is quite elementary and well known. 

Let g be a semisimple Lie algebra over R. A Cartan involution 6 of g 
is an isomorphism of g such that 6° — 1 and the quadratic form B(X,6(X)) 
—tr(ad¥adeX) (XE gq) is negative-definite on g. The following result is 
due to Mostow [8, Theorem 6, p. 53]. 


Lemma 26 (Mostow). Let g be a semisimple Ine algebra over R and 
gı a semisimple subalgebra of g. Let 6, be a Cartan involution of gı. Then 
6, can be extended to a Cartan involution 6 of g. 


14. Some computations. We now return to the notation of §12. Since 
q =~ dim g— dim ax,21, X,7£0. Therefore by Lemma 24, we can choose 
Ho, ¥o€ g such that [Ho, Xo] —=2Xo, [Ho, Yo] =~ —2¥o, [Xo Yo] = Ho. Let 
I=RH,+RX,+RY,. It is easy to see that I is a three-dimensional sub- 
algebra of g and the linear mapping 


bo: (Xo, Yo, Ho) > (— Fo, — Xo, — H0) 


defines a Cartan involution of I. Therefore, from Lemma 26, we can extend 
it to a Cartan involution 6 of g. Introduce the structure of a real Hilbert 
space on g by means of the positive-definite quadratic form 
I21?—=—B(Z,6(Z)) (Zee). 
Lemma 27. Let X€g. Then the Hilbert-space adjoint of adX is 
—ad a(x). 


Let <Y,Zy=—B(Y,6(Z))=—B(#(Y),Z) (¥,Z€q) denote the 
scalar product in the Hilbert space g. Then 
<[X, ¥],2> =— B([(£), 0(¥)], Z) 
= B(4(¥), [6(X),2]) 


and this is equivalent to our assertion. 
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We can take (in 812) U and F to be the orthogonal complements of gx, 
and gx, respectively in g. Then we have the following result. 


Lamaca 28. U—=6(ax,) and V—4(gr,). 
Let Z€ ax, and Ye gq. Then 


<9(Z), [Xo ¥]> =— <[8 (Xo), HZ), Y> 


from Lemma 27%. But [6(X,),0(Z)]=6([X,2]) == 0. This proves that 
6(3x,) is orthogonal to gx, But 


dim f (32,) == dim gx, = dim g — dim gz, = dim U. 
Hence 0(3x,) =U. 


Since B is invariant under 6, it is clear that # is unitary. Therefore the 
orthogonal complement of 6(gx,) is 0°(3x,) = 4x, This proves that V == 6(qx,). 
Let p denote the representation Z>adZ (Zel) of I on g. Since 
6(1) =I, it follows from Lemma 27 that p(I) is a self-adjoint family of 


linear transformations on g. Therefore we can write g= $, g; where 
1Si&r 


0: {0} is a subspace of g which is invariant and irreducible under p and 
the sum is orthogonal. Furthermore we may assume that gı == I. 

Note that 9(X,)=—T7,. Hence U=#(3x,) 3y, where jy, is the 
centralizer of Y, in g. Similarly V—=6(gx,) = [Yo g]. Therefore Y,EU 
and H, =— [Yo Xo] € V. Since gx, is the kernel of the endomorphism 
p(Xo) of g, it is clear that 


ax D X N Gi 
1SiSr 


Lty+l=dimg so that 20 (1<Si<r). We know from Lemma 25 
that dim(ax,Ng) = 1. Let w: be a unit vector in 3x, N g Then p(y) ws 
==A,w', from Lemma 25. Put w=#(w,). Then 


[Ho wi] —= —4([H,w;]) = — 49 (ws) = — Ag; 
and 1,‘ - ",w, is an orthonormal basis for U == 6 (3x,). 
Lemma 29. Let n= dimg. Then 
n= 3 (+1), redimgx, 
Ir 
This is obvious since g = J g 
i 


Let (t1, + +,u,) denote the Cartesian coordinates in U with respect to 
(w: < +, w) so that u= Zum (uc U). Then d(w) = d/du. 
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Lemma 30. Let D denote the vector field on g defined by Dxy—4(X) 

(X€g). Then D is invariant and 
A(D) = 3 (14+ 41) adi 
1StsSr 

where d; == u0/Ou, (1SiSr). 

Since (Dr) == (8(X))* = (1X) = Day (sE G,X Eq), it follows that 
D is invariant. 

Now fix u€ U’. Then 

TH @1) = [Ho Xo + uj =2X,4+ [Ho 0]. 

Therefore 
Ten ®81+18 (u—$s[Ho,u])) =X +u. 


Now [H,U] C U since U=3y, Therefore 
Ay(D) = 4(u) —30([Ho, u]). 
But u = Zum and so . 
l u— 41 Ho, u] =X (1+ pu) ws 

Therefore 

Au(D) == 3) (1 + $A) 140 (104) (ue U’). 
Lemma 81. Fis integers m0 (1SiSr), put . 

dd (w mw m > - Wr) 


and define D and dy (1S1 &r) as above. Then? {d, dj} — md and 
* If D,, D, are two differential operators, we denote D,oDs—D,o0D, by {D, Da}. 
l (40A(D)*)o=— 3 (1+4u)(m-+1)d. 
ister 
It is clear that 


{8 (w), ds} == 84:0 (wi). 
Hence for a fixed 4, 
` {d, dy} — {8 (my), di} d’ 
where q’ = I0 (w). But it is obvious from the formula above that 
f 
{8 (wi), dy} = md (wy) 


and therefore {d, di} == md. Moreover 4*—=— (d;+1). Hence 


An (1+ $m) (&+1) 
from Lemma 30. Also 
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A (4, dy} + hä (y+ ma) ds 
Therefore since (did). == 0, we have (dd)o = md. Hence 
(doA(D)*)om— 2 (1+ 4m) (m + 1) 4. 


Let 3: be the centralizer of lin g. 
Lemma 32. The following four conditions are mutually equivalent. 


(1) w is identically zero on U =ay,; 
(2) w is identically zero on 0(U) = 4x,; 
(83) M>0 ISi<r); | 
(4) a= {0}. 


We know that o is invariant under 9. Hence (1) and (2) are equivalent. 
Since Xo, Y, generate I as a Lie algebra, it is obvious that 3r = ax, May, Let 
- px denote the representation of I on g; defined under p (1Si=Sr). Then a 
is the zero representation if and only if A =0. On the other hand dim 4 is 
the number of times the zero representation of [ occurs in the complete 
reduction of p. Hence 

i dim a= 3 (M+ 1). 
Ay=0 


This proves that (3) and (4) are equivalent. 


Now assume (2) holds. Then B(X,Y) =0 for X,Y € gx, and therefore 
x, and 6(3x,) == gy, are mutually orthogonal. But then r= x, N ay, = {0}. 
Therefore (2) implies (4). 

Conversely suppose (3) holds. Then 3y,—= U—2Ru, and 


B(w, w) = — <0 (w), 04> GS Sr). 


We have seen that w; == 0(w,) and w; are eigenvectors of p(H,) belonging to 
the eigenvalues A, and —A, respectively. It follows from (8) that these two 
eigenvalues are distinct. Since p(Ho) is self-adjoint (by Lemma 27), the 
vectors w; and w; are orthogonal. Hence B(w, w) =0 (1Si,jSr). This 
shows that (3) implies (1) and so the lemma is proved. 

Now consider the differential operator A(d(0)) on U’. It is clear (see 
the remark at the end of §7) that its degree is <2. As usual A,(d(w).) 
denotes its local expression at zero. 


Lemma 33. The homogeneous part of mee 2 of Av(d(w)) is zero if 
and only tf a= {0}. 
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Choose a base 4, (1Si=Ss) for V. Then [Xu], wu; (1SiSs, 
1=Sj>r) is a base for g. Hence 


o— DS at[X, 0] [Xow] + E bway 
1St,jSs 1mt,jSr 
E E HX, wy] wy 


1SitSe 15j8r 


where a! — ait, bÏ — bit and cti are in R. Let - denote product in ©. Then 


Tx (v; “Uy ® 1) m [Xo vi] [Zo v] zZ Lu, [Xo, v] l; 
and 
Lr (1: 8 w) = — [Xo, vi] wy + Lv, w]. 


Therefore if A denotes, as usual, the canonical mapping of 8 (g) onto ©, 
we get 
D 09T, Amy) @1)— 3% D cL x, (48 w) 


154,458 1S1Ss 1Sf=r 


= 2 as] Xo, vi] [Xo vy] — at) [vs [Xo v4] ] 
+ È cH X, vu Jwy— 2% W [v w;] 
4 13 


=o— 3 b¥wwyt+p 


181,J<r 


where p is an element of S(g.) of degree <1. This shows that the homo- 
geneous part of degree 2 of A,(d(w)) is È b410 (wiw) == X, ONG? /dundu,. 


4,3 


So it remains to show that bti — 0 a Sij Sr) if and only if a= {0}. 
Now gx, is orthogonal to U = 0 (3x,). Therefore B(X,Z)=0 for X€ gy, 
and Z€ gx, Hence if v¢ V, [Xo v], regarded as a linear function on g, 
vanishes identically on ax, Therefore if X € 3x, 


o(¥)= 3 bYB(w,X)B(w,X). 
1S4,jSr 


Now °° ,w, is an orthonormal base for U. Hence 6(m) (1SiSr) 
is a base for 0(U) == gy,. Let X = > t6(w;)(¢€R). Then it follows 
isir 


from the above orthonormality that B(w, X )=— 4. Hence 
o(X)= © bit. 
154, jSr 
The required result is now obvious from Lemma 32. 
COROLLARY 1. Suppose zr {0}. Then if zeS(U,) and 
(8(z) ° A(d(w))*)o—0, 


we can conclude that z= Q. 
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For otherwise suppose z 40. Let m be the degree of z and z, the homo- 
geneous part of degree m of z. Put A—=A(ö(o)). Then i 


A= 2 ay? /Oudu+ D m/b +a 
151,j&r ár 


where dy = ap, a; and a are Ge functions on U’. It follows from Lemma 33 
that 
2 au 0) 0°/ Buy 7 0. 


Moreover it is clear that 
(At Zay Bt /Ousiuy + Zb 8/Bu +B 
where b, and b are also O” functions on U’. Since 
- da) o A* = A* 08 (2) + {d(2),A*), 
it is clear that the hömogensoda part of degree m +2 of (8(z) oA*), is 
ES ô (z0) 0. 


Therefore (@(z) o A*) 340 and so we get a contradiction. 


COROLLARY 2. If 3,54 {0}, then z= 0 in the corollary of Lemma 23 and 
therefore op =Q. 


For since (w) T = 0, we conclude from Theorem 3 that Acr==0 where 
‘A=A(8(o)). But then it follows from the corollary of Lemma 23 that 
B(0;8(z) oA*)—0 for every BEC.”(Uo). This however implies that 
(8(z) 0A*)o=—0. Our assertion now follows from Corollary 1 above. 

Thus in order to complete the proof of Lemma 17, we may, from now 
on, assume that 37 {0}. Then, by Lemma 32, w vanishes identically on 
U =f (3x,) and gx, Therefore 


w(Zo-+u) =o(Z) +o(u) + 2B(Xoyu) — 2B (Zo u) 


for u€ U. Now w, could be chosen to be any unit vector such that 
a (w) E f Nax =RX.. (We recall that gı =I.) So we may take 


w, = || Y, |+.. 
Then 
Uy <W, U> = — B (0 (w1), u) = | Yo [7B (Xo u). 


Hence o(X,-++u) =2cu, (uc U) where c= || Xo | =f F, l|. We also note 
that dim gı = dim 1 — 3 and therefore A, = 2. 
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Now ow vanishes identically on N. Therefore, by Lemma 21, there exists 
an integer k = 0 such that «*T —=0 around Xo. On the other hand Lemma 
19 would be proved if we can show that T = 0 around X.. Therefore it would 
clearly be sufficient to obtain the following result. 


Lemma 84. Fix a point XEN and an integer k= 0 and let q be the 
topological dimension of the orbit X,@. Let T be a locally invariant distribu- 
tion on some open neighborhood Q of X, in g such that 


1) #T—=0, (o)T=0 
2) SuppTCNH,NQ. 


Then T =Q around Xp. 


The case k= 0 being trivial, we assume k = 1 and use induction. Also, 
in view of our results above, we may suppose that q = 1 and 3;=~ {0}. . Finally, 
we may assume that X,€ Supp(«t*T) for otherwise the assertion of the 
lemma would follow immediately from the induction hypothesis. 


15. Some algebraic lemmas. We now study some simple algebraic 
properties of the differential operator D of Lemma 30. 


Lemma 85. Let p€ Sn(g.). Then Dop—=p(D--m) and ö(p)oD 
— (D +m) °8(p). 


For any fE C”(g) and ZER, let fs denote the function X— f(t) 
(X€g). Then 


F(Z; D) —f(X50(Z)) = (af (tX)/ abo (X€g) 
and therefore Df = (dfı/dt).-ı. Hence 
D (pf) = {4 (pf) :/dt} 121. 
But it is obvious that 9, = 7p and therefore (pf);,— pıfı— t"pfı. Therefore 
D(pf) = {4 (t"pf:) /dt}ı = mpf + pDf 
and this proves the first statement. 


Now we come to the second part. Let X., *‚,X„€g. Then 
F(X; (XXa j Xm) = {fX + hE + ` F ink m) bti: $ im} ty =ta=0 


= {0m (tX + Ky: m tr: © e tm} ye tao 
== "f(X; A(X - Xm)). 


This shows that d(p)fı = t"(d(p)f): for pE Sm(g.). Therefore 


304 HARISH-CHANDRA. 
dp) (Df) = (4(8(p) fr) /at) 11 = mA (p) f + (d(8(p) f) +/dt) tor 
= mi(p)f+D(a(p)f). 
This completes the proof of Lemma 35. 
Lemma 36. Put n—=dimg. Then 
(lu), 0} —4(D-+n/2). 


Let X, (1 Sin) be a base for g and X* (1Stsn) the dual base go 
that B(X*, Xj) = 34. Let Xt —= N gi; and Ti BX! (gy g” € R). Then 
2 


g = B(X', Xi), gy— B(X,,X;) and the matrices (g*) and (gy) are inverse 
to each other. Moreover 

(X) X= B(X, Xj) = gy. 
Now let X = F tX, (BER). Then 

fi 
o(X) = > tttiB (X, X,) = 5 yet. 
43 i,j 

But #—=B(X%,X). Hence 

om ZOLL EUER, 


and therefore 
{0 (Xz); 0} = z (gu; + Zigi) 


— X, 
Hence 


(lo) u) =X ({0(4*), ©} 08 (Xa) +0(X*) © {0(Xp), 0}) 
—22 (I0 (Xa) +0 (Xr) or) 
= 2n 445Z). 


So it remains to verify that 2 XI (X:)==D. This is seen as follows. Tf 
k 


X €g, then 
(3 I (X) )x = Z B(X* X)O (X) =ô(X) = Dx 


since B(X*, X) = t if X= TAY, (FER). 
k 
Corouzary. Let | be any integer =1. Then 


lo), of} = 4o (D n/a +1—1), 


If ¿= 1, this follows from Lemma 36. So assume 1 = 2 and use induc- 
tion. Then wt == ww! and therefore 
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{8(o), of} = {8 (0), 0} 0 0 + ofl (0), 0} 
—4(D+n/2) cot + 4(1—1)o (D +n/2+1—2) 


by induction hypothesis. But (D + n/2) 0o =o (D + n/2 4 2—2) 
from Lemma 35. From this the required result follows immediately. 


16. Completion of the proof of Theorem 4. Now we return to the 
proof of Lemma 34. Put ,=(D-+n/2-+k—1)T. Since D is invariant, 
T, is a locally invariant distribution on Q and Supp T, C Supp T. Moreover 

0 = f(v) (HT) — o*(8(o)T) 
= 4hutT, 


from the corollary of Lemma 36. This shows that o*T,—-0. Moreover 


Ilo) To = 08 (o) (D+2/2+k—1)7 
= (D-+n/2 +k +1) (o) T =0 


from Lemma 35. Thus T, satisfies all the conditions of Lemma 34 with k 
replaced by k— 1. Hence by induction hypothesis To == 0 around Xo. So by 
replacing ©, if necessary, by a smaller open neighborhood of X,, we may 
~ assume that To==0 on Q. Therefore (D + n/2 +k—1)T = 0. 

Let ö, denote the distribution 8—>8(0) (BE C.” (U.)) on Uy. Then, 
from Lemmas 20 and 23, we can choose z€ S(U,) such that op —=9(z)&. 
Tf pE I(go), it is obvious that A(p) = q where q is the polynomial function 
u>p(X, +u) (we U’). Since o(Xo -+ u) =2cu, (u€ U), it follows from 
Theorem 3 that o mr = (2c) "8 (z), for any integer m> 0. Therefore since 
wT = 0, Xo E€ Supp( T) and (D+ n/2+k—1)T=0, we obtain the 
following result by taking into account Theorems 2 and 3. 


Lemma 37. u,*0(z)8) =0 but uy**0(z)8,540. Moreover 
(A(D) + n/2 + 4—1)0(z)8& —0. 
The following lemma is proved by a simple calculation. 


LEMMA 38. UPI (ww: - wm) = 0 tf p> m, and 





! 
= ( 1)? a J i Ô (w, "Pw, ma. z -w™r) Bo 
= 
if pS m. 
Put d(m) = 8 (wm: - -w,mr) for m= (m,,---,m,) and suppose 


92) =Zc(m)d(m) 
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where c(m) are complex numbers which are zero for all m except a finite 
number. Then 
0 — 1*0 (2) 8o 


N D e(m)(— 1m l/m — k) dw twm. -mrio 
MER Ma me 


"and therefore it follows from Lemma 20 that e(m) —0 if m =Æ k. Similarly 
u0 (2) 85 . 
= > 5 m) (—1)F (my Ylmı —k+ 1) Dalweg. - + wry, 


mek- Mu Mre 
Therefore it is obvious from the above result and Lemma 37 that c(m) 340 
for some m with m, = k — i. 
On the other hand 


S c(m) (A(D) +n/2 + k—1)d(m)a, 0 

from Lemma 8”. It follows from Lemma 31 that 
A(D)d(m)8o—=— Z (143%) (m + 1)d(m)&o. 
Therefore 
Ze(m) {n/2 + k—1—Z (1+ Hu) (m+ 1) }d(m)B = 0 
and this implies that c(m) —0 unless 
z (14u) (m41) =n/2+k—1. 
But Z(1+3%) —d(n-+r) from Lemma 29. Therefore if c(m) #0, we 
must have l 
2 (1+ 44) m + 1/2 =k—1, 


Since r==1 and A,=2, this implies that 2m,<k—1. However we have 
seen above that c(m) 540 for some m with m,—k—1. This contradiction 
completes the proof of Lemma 34 and therefore also of Theorem 4. 


17. Proof of Theorem 5. It is now easy to generalize Theorem 4 as 
follows. 


Tuxorem 5. Let T be a distribution on an open subset Q of g. Assume 
that i 
1) T is locally invariant, 
2) prenne, 


INVARIANT DISTRIBUTIONS ON LIE ALGEBRAS. 307 


3) T satisfies an equation of the form $, Al) T=-0 where cy are 
or 


complex numbers not all zero. 
Then T =Q. 


Let & be the space of distributions on Q spanned over C by ô(a*)T 
(k=0). Then, in view of condition (3), dim Z <œ. Since TER, it 
would be enough to prove that = {0}. So let us assume that T {0}. 
Since #(w) defines a linear transformation in X, we can choose T,3£0 in X 
such that ô (o) To= cTo for some c€C. It is clear that every distribution 
in X satisfies conditions (1) and (2). Fix a point X, in the support of To. 
Since w vanishes identically on 7, it follows from Lemma 21 that we can 
choose an open neighborhood Qo of X, in Q and an integer k = 0 such that 
wT, = 0 on Qo. 


Lemma 39. For any differential operator D on Qs, define 
doD = {8(w), D}. 

Then if DTo=0 on Ro, the same holds for (dyD)T». 

Let D = dD. Then 

D'T <= 8(w) (DT,) — D (3 (w) To) 
== (ê (o) — e) (DTe) = 0 

on Qo, since ĝ (w) To = cTo. 

Therefore we conclude by induction on r that (dur) Te = 0 on Qo. But 
dook waz 2 129 (u) (see [4(c), p. 99]). Hence 8(Æ)T = 0 on Q. How- 


ever Î (ot) To == +T. Therefore since X, € Supp To we must have c—=0, 
But then T, ==0 from Theorem 4 and so we get a contradiction. 


18. Appendix. The results of this section were pointed out to me by 
A. Borel and they are reproduced here with his permission. 

We use the terminology of [2, 881-2]. 

Lemma 40. Let GC GL(n,R) be a real algebraic Lie group. @ an 
open subgroup of G, f:@4—>GL(m,R) a rational representation of G and 
X—=f(@)-a (xve R”) an orbit of @’. Let q be the topological dimension 
of X. Then X is open in? CLX and CLX N °X is the union of orbits of Œ 
of dimension < q. 


*° For any set U, ClU stands for the topological closure of U and °U for the com 
plement of U. 
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Let G, C GL(n,C) be the smallest complex algebraic group containing 
G. Then f extends uniquely to a rational representation fe: G.—> GL(m,C) 
[3(b), Prop. 4, p. 109]. Consider the orbit Y=f,(@,) +z in C”. On each 
irreducible component of @,, the map g>f.(g) x is rational and regular 
and therefore Y is a complex manifold of complex dimension q. Since the 
image of an irreducible variety under a rational regular map contains a non- 
empty Zariski-open subset of its Zariski closure, it follows that Y contains an 
open everywhere dense subset of Cl Y and that V==ClY is an algebraic set 
of algebraic dimension g. By homogeneity, Y is open in V and consists of 
simple points and VM °Y is an algebraic set of algebraic dimension g < q. 
Also since G is Zariski-dense in Ge, by definition of Ge, it is clear that V is 
the smallest algebraic set containing f(@) <. 

Let a€ Yg. Then a is simple on V and there exists a neighborhood U 
of a in R” such that U N Vp is a connected manifold of dimension q (see 
Whitney [10, §11]). On the other hand the isotropy group of'a in @ is 
contained in the set of real points of an algebraic group of complex dimension 
r—q where r = dim G. Hence its dimension is Sr—q. Therefore f(@’) a 
has dimension = q and so it contains UN Vz if U is taken sufficiently small. 
This shows that a @’-orbit in Yp is open in Vp. Therefore °X N Yp, being a 
union of such orbits, is open in Vg. Hence X is closed in Yg. This proves 
that CIV Yp==X and therefore CLX C XU (Van YR). Since V N'Y 
is an algebraic set of algebraic dimension g < g, the topological dimension 
of VrN°Far= (VOY )pis Sq. (This follows by induction on dimension 
from [10, Theorem 1 and Lemma 9].) Since (VM °Y), is stable under G, 
our assertion follows immediately. 


COROLLARY. Let A be a real algebraic subset of R™ which is the union 
of a finite number of @’-orbits. Let A, denote the union of all G’-orbits in A 
of topological dimension <q. Then A, is closed and each GQ’-orbit of 
dimension q is open in Ag. l 


It is clear from the above lemma that A, is closed. Let X=f(@) z 
(z€ A) be an orbit of dimension g. Then a Lemma 40, A N °X is closed 
and hence X is open in A,. 


It is now easy to give a proof of Lemma 17. Take @ to be the group 
of all automorphisms of g and @ the connected component of 1 in G. Then 
G is an open subgroup of the real algebraic Lie group G. Let n= dim g. 
Define polynomial functions p; (0Si<n) on g by the relation 
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det(t—adX)=—= 3 p(t -+t (Xeg), 
0Si<n 


where ¢ is an indeterminate. Then obviously N is the set of all common 
zeros of pı (0Si<n) ing. Hence N is a real algebraic subset of g. 
Lemma 17 is an immediate consequence of the above corollary if we take 
A=, 


INSTITUTE FOR ADVANCED STUDY. 
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COMMUTATORS, ABSOLUTELY CONTINOUS SPECTRA, AND 
SINGULAR INTEGRAL OPERATORS.* 


By ©. R. PUTNAM. 


1. Introduction. Let § denote a Hilbert space of elements 2,y,- - -, 
with the inner product (x,y). Only bounded operators A,B,:- -, on $ will 
be considered. For such an operator A, let | A || denote the usual norm 
defined by | 4 || sup] Az], with | v|/—1, and let sp(A) denote the 
spectrum of A. If A is self-adjoint with the spectral resolution 


(1) A= frdB(a), 


then the set, a, of elements x in § for which || E(A)z lj? is an absolutely 
continuous function of A, is a subspace of § which reduces the operator A; 
cf. Kato [4], p. 240, Kuroda [7], p. 486, Halmos [17], p. 104. The operator 
A will be called absolutely continuous if § = §,. 

For any pair of operators 4 and B with the commutator 


(2) AB—BA==C, 


let Ma be the smallest subspace of § which reduces Im(B) = (B—B*) /2 
and which contains R(C), the range of C. Let dg denote the difference 
between the maximum and minimum points of sp(Im(B)). The symbol 
“meas” will refer to ordinary one-dimensional Lebesgue measure. There 
will be proved the following 


THEOREM 1. Let A be self-adjoint, B be arbitrary, and the commutator 
C of (2) be self-adjoint and satisfy 


(3) C=0 (or 0&0). 
(I) Then 
(4) r || C | S (ds/2) meassp(4), 
and hence 
(£) aC || S| B || meas sp (4). 


Received June 28, 1963. 
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(IT)* In addition, 
(5) N C $a, 


where N denotes the smallest subspace reducing A and containing Me. 
There follows the 


CoRoLLARY of (I). If A is self-adjoint, B is arbitrary, and C of (2) 
is self-adjoint and satisfies (3), then 


(6) LOLS (%r) 1411B1. 


The inequalities (4), (4) and (6) are optimal in the sense that there 
exist examples (see Section 5) fulfilling the hypothesis of Theorem 1 for 
which equality holds in (6), hence also in (4) and (4). On the other 
hand, it is clear that for arbitrary A and B the inequality | 4B— BA |] 
<2 |4] || Bl] is the best possible. In fact, as examples with finite matrices 
shows, it can happen that A and iB (hence also AB--BA) are self-adjoint 
and that 0 < || AB—BA||—2]4]| || B || holds. Thus the restriction (3) is 
essential for the general validity of (6). In this connection, see the discus- 
sion of [12], pp. 215, 217; it can be noted that the above Corollary answers 
the question raised on p. 217. 

A theorem similar to (I) but where the role of the self-adjoint A is 
played by a unitary operator U was given in [12], p. 217. Since this result 
will be needed in the proof of (I) it will be stated as a 


Lemma. Let J denote a bounded self-adjoint operator, let U be unitary, 
and suppose that UJU*—J=D=0 (or <0). Then 


(7) meas sp(U) 2 2x || D |//d, 


where d denotes the distance between the maximum and minimum points 
. of sp(J). 

The proofs of (I) and (II) will be given in Sections 2 and 3. Applica- 
tions to the investigation of the spectra of the singular self-adjoint integral 
operators A on §—L* (a,b) of the form 

v 
(8) An h(t) x(t) + m) f 9°) (s—t)74(s) ds 
a 


will be given in Sections 4 and 5. 
Concerning (8) and similar operators, see [1], [2], [3], [5], [6], [8], 
[9], [13], [14], [15], [16] and their bibliographies. 


*Bee Appendix. 
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The author is indebted to L. de Branges for valuable discussions con- 
cerning portions of the subject of the present paper and for making available 
the paper [9] of J. D. Pincus. 


2. Proof of (I). On taking adjoints in (2) it is seen that 
(9) AJ —JA m=—iC, where J = (B— Br) /2i. 


Hence (A Be -+- 12) =«— iC and, on applying (A--i/)-! on the 
right and left in (9), one obtains 


(10) JAH) — (AH) Te — (A HET) OA HIT). 
If U denotes the Cayley transform of A, 
(11) U= (AM (44i) (—I—24(4 44>), 


it follows from (10) that JU — UJ = —%(A + il) "C(A-+ il)", and conse- 
quently, 
(12) ` UJU*.— J —2Q*CQ, where Q = (A —tI)7. 


If now the present J defined in (9) is identified with that occurring in 
the Lemma and if D—2Q*CQ, it is seen that D=0 (or D0) and hence, 
by (7), 

(13) meas sp(U) Z 2r | D |/d, with d= dy. 


But | Q*CQ | —sup(Q*CQz, £) = | C int | Qz |*, where |x] —1; also, by 
(1) and the definition of Q in (12), Q = f (A—t)“dH (A), and so || Qa |]? 
= (1+ | 4 |?) Consequently, relation (13) implies 


(14) meas sp(U) >4r | O/d(L +14 |). 

If «a is defined by 
(15) et—= (A—1) (A-++4)7, where —wo <A <œ and 0 <a < 2x, 
it is easily verified that da—=2(1-+x%)" dà. Hence, if 8 denotes the set of 
values a on (0,2r) for which e* is in sp(U), then by (11), 

(16) meas sp (77) = f da—2 | (AH dà Z 2 meas sp(A). 
| Js sp(4) 
If now ¢ denotes a positive real number and A;= t4, then, since 
. tC —A,B—BA,, 
relations (14) and (16) yield 
(17) 2 meas sp (At) Z trt || C |/da (1 +ë || A |). 
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Since meassp(A;) =tmeassp(A), division of (17) by ¢ followed by t—> 0, 
leads to the desired relation (4). This completes the proof of (I). 


8. Proof of (II). Relations (2) and (3) imply that A is absolutely 
continuous on R(C), that is, that | E(A)y |? is absolutely continuous when- 
ever y==Cz; see [10], p. 1027, [11], pp. 514-515, also [12]. As above, 
relation (9) follows from (2). Let ¢ denote any real number not in the 
spectrum of J, as defined in (9), and put ,—=J—iI. Then AJd;—J;A 
=—1C and hence 
(18) ` AJr —I PAST CI 


It follows as before that A is absolutely continuous on R(J CJ), that is, 
on R(J;7C). Since ¢ is not in sp(J), then also s is not in sp(J) for s 
sufficiently close to £, hence A is absolutely continuous on R(J,C) for | s—t| 
sufficiently small. Since §, is a subspace, and since d”/ds"(J,+) = n!J 77, it 
follows that A is absolutely continuous on the range of J;-™C for m =a 1,2, +, 
as well as for m=-0. Consequently, A is absolutely continuous on the smallest 
subspace reducing J; and containing R(C). But this space is identical with 
Dès, the smallest subspace reducing J and containing R(C). Since, by (1), 
the absolute continuity of | Z(A)z |? implies that of [Z(a)Arz]? for 
n—=0,1,2,- + -, the assertion (5) follows and the proof of (IT) is complete. 


4. Applications to integral operators. Throughout this section it will 
be supposed that $ == L?(a,b) where —wo<a<b<o. In addition, it will 
be supposed that the operator A on L*(a,b) is defined by (8), where A(t) 
is real-valued, &(?) is complex-valued, and where both functions are bounded 
and measurable on (a,b). I£ the integral is the Cauchy principal value, then 
A is a bounded self-adjoint operator on L*(a,b); cf. Schwartz [13], Section 2, 
also Dao-xeng [16], p. 244. Henceforth B will denote the multiplication 
operator on L?(a,b) defined by 


(19) Bu=ite(t). 


Let Z be defined by Z={t:a<t<band ¢(t) —0}. It is clear that 
L?(Z) reduces both A and B and that for sin L?(Z), Ar=h(t)z(t). Hence, 
in order to investigate the operator A, it is sufficient to restrict A to L?(Z*), 
where Z* == (a,b) —Z. There is essentially no loss of generality in supposing 
that Z* — (a,b), and there will be proved the following 


THEOREM 2. Let o(t) be a complex-valued, bounded, measurable func- 
tion on (a,b) satisfying 


(20) p(t) 0 almost everywhere, 


- B14 C. R. PUTNAM. 


and Tet h(t) be an arbitrary real-valued, bounded, measurable function on 
(a,b). Then the bounded self-adjoint operator A on $—=L?(a,b) defined 
by (8) is absolutely continuous, that 1s, 


(21) a= L (a,b), 
and, in addition, i 


: 
(22) Sf 1$ ats (1/2) (6a) meassp (A). 
a 
It is noteworthy that no assumptions of smoothness (not even of con- 
tinuity) are imposed on either ¢(¢) or k(t). 
Proof of Theorem 2. It follows from (8) and (19) that 


(23) (AB—BA)o—x* |" 6(t)4*(s)2(0) deme, 


(CE Friedrichs [3], p. 369.) Since Cr—a74(t)(2,$), it is clear that 
(Cz, 2) =r | (z, ¢)|? = 0, so that (3) holds. In addition, it is clear that 
| C | => ] ¢]]?. Moreover, 


(24) (BBY) Rei, 


so that de =b —a and (22) follows from (4) of Theorem 1. 

There remains then to prove (21). It follows from (24) .and the 
definitions of Mr that Ms contains the closure of the linear manifold on 
I? (a,b) spanned by the functions i*¢(¢), where n~=0,1,2,---. Relation 
(20) implies that My» — L? (a, b), hence N= L? (a,b), and (21) follows from 
(5) of Theorem 1. 


5. A special case. If h(t) =0 and $(¢)==1, then A of (8) reduces 
to the operator 


(25) A (in) f "=v: 
According to (22), l 
(26) a meas sp(A,) = 2. 


On the other hand, || A [| 1; cf. Koppelman and Pincus [6], p. 399, also 
Dao-xeng [16], Lemma 3, p. 236. Since meassp(A) S?2]A ||, there now 
follows from Theorem 2 the result that 


(27) A, is absolutely continuous with the spectrum [— 1,1]. 
(Relation (27), and even more, has also been obtained though the use of 
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Fourier transforms by Koppelman and Pincus [6]. See also Widom [15], 
p. 152.) 

The above example clearly furnishes an instance of equality in (22) and, 
in case b = — a, also in (6) with C20 and C540. 


6. Remarks. Theorem 2 can be considered as a result concerning 
certain perturbation of bounded self-adjoint multiplication operators on 
L (a,b). In fact, consider the family Te defined by 


(28) Ta—hlt)eit) Hei, 20, 


and where h(t) is real, bounded, and measurable on (a,b). Then 7, is the 
multiplication operator h(t), the spectrum of which, of course, need not be 
absolutely continuous. Also, since h(t) is not required to be continuous, 
sp(7,) need not be an interval. However, by Theorem 2, whenever «> 0, 
Te must be absolutely continuous and meassp(7.) Z 2e. Also, the spectrum 
of T. need not be an interval, even though sp(eA,) is [—«,e]. In fact, if A 
is not in sp(To) then A is not in sp(Te) for e sufficiently small; hence, if 
sp(7,) is not an interval then neither is sp(Te) for e sufficiently small. 

From a different point of view, if the multiplication operator A(t) is 
regarded as a perturbation of Ao, so that by (8), 


(29) Tr = h(t)a(t) + Aoz, 


then Theorem 2 assures a certain “stability” of the spectrum, both with 
respect to absolute continuity and to measure. Thus T, as well as Ao, is 
absolutely continuous and moreover meassp(T) =2 (= meassp(A,)). That, 
again, sp(T) need not be an interval, is clear from the observation that h(t) 
of (29) can be identified with A(t)/e of (28). 

Finally, it can be remarked that Theorem 1 can also be applied to 
certain singular integral operators similar to (8), but with symmetric kernels 
K(t,s) more general than that of $(t)¢*(s), provided that the corresponding 
operator C (cf. (23)) satisfies the essential restriction (3). 


Appendix. 
It will be shown below that the assertion of (II) can be clarified in 
the following equivalent form: 


(IV) Under the assumptions of Theorem 1, 


(5’) BC Do 
where & denotes the smallest subspace reducing both operators A and Im(B), 
and which contains the range of C. 
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That N C & is clear. It will be shown that N == Q, so that (IT) reduces 
to (II). In order to see this, first note that the space N is the closure of 
the linear manifold of vectors y-DA"I"Crn (m,n = 0), where the zya 
are in § andJ=Im(B). On the other hand, & is the closure of the linear 
manifold spanned by the vectors of the form z == POr, wher z is in § and P 
is a product of a finite number of factors of non-negative powers of A and J. 
It follows from (9) however that every vector of the type z above can be 
expressed as a vector of the type y, and hence N = Q. 


PURDUE Unrvanstry. 
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PARTITIONS INTO ODD AND UNEQUAL PARTS. 


By Prrer Haaıs, JR. 


1. Introduction. In [2] the author has obtained a convergent series 
and asymptotic formulas for g(n), the number of partitions of a positive 
integer n into positive odd summands. The necessary transformation equa- 
tions as well as estimates of the magnitude of certain sums of roots of unity 
were obtained by using essentially the same procedures as Lehner [4], while 
the circle dissection method of Rademacher [6] was employed for the inte- 
gration. In the present paper we shall impose an additional restriction on the 
partitions, namely that the summands be distinct. That is, we wish to find 
a convergent series and asymptotic formulas for Q(n), the number of parti- 
tions of a positive integer n into odd and unequal parts. Q(n) also represents 
the number of self-conjugate partitions of n (see pp. 278-9 in [8]). The 
investigation is parallel to that in [2], and free use will be made of the 
results obtained in the earlier paper whenever they are applicable. 


2. The transformation equations. Several generating functions, each 
convergent in the interior of the unit circle, will be needed. We list these here. 


F(a) - (1— am) =| +Š). 
G(2) = TI (1+2) =F (2)/F (2) = 1+ È O(n)» 


H(z) =Ï 0 4am) m 1/F (2). 


Now let k be a positive integer, let h satisfy the condition (h,k) ==1, 
and let æ (z) >0. Then Theorem 1 in [2] states that 


F (exp{2rih/k —2mz/k}) = o (h, k) exp{x(2— 1/2) /12k} 


(2.1) , 
"F (oxp{2ath’/k — 2a/2k}) 
if 2 | k, and 
(2.2) F (exp{2rih/k— 2n2/k}) = 25x (h, k)exp{r (1/2 + 22) /24k} 
Í - H (exp{2riH’/k —r/zk}) 
it 21%. 
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Here, hh’ =— 1(mod k), 2hH’ ==— 1 (mod k); 
 o(h,k) = exp{rio (h, k)}, 
o(h,k) = ((n/k)) ((ha/k)), w= 1,3,- ,k—1; 
x(h, k) = exp{rit (h, k) }, 
t(h, k) = I (p/2k) ) ((hu/k)), p=1,8,: + +, 2k —1; 
((«))=2— [2] —4$-+48(c) where ö(z) == 1 if v is an integer 
and 0 otherwise. 


(2.3) 


(2.4) 


With the aid of this theorem we can now derive the necessary trans- 
formation equations for @ (z), the generating function of Q(n). Three cases 


must be considered. 
If 4|% and 


(2.5) _ T == exp{Amih/k — mz /k} 
then 2? — exp{2nih/k* —2n2z/k*} where 2k* =k and 2|%*. Since G(s) 
= F (x)/F (x°) we have, applying (2.1), 

| (2) =w (h, k)esp{m(1/.—2)/12k}G (7), 


where 
(2.6) x = exp{Arih’/k —2r/zk}, 
(2.7) w(h, k) =o(h,k)/u(h,k*). 


If k=2 (mod 4) then 2fk*. Applying (2.1), (2.2) and recalling that 
1/H (z) =F(r) we have 


G (2) = W (h, k)exp{m(—8— 2/2) /12k} F(a’) F (exp{2nig’ /k* —m/cht}), 


where 
(2.8) W (h, k) = o (h, k) /x(h, k*), 


and 2hg’==— 1(modk*). Since hh’ ==— 1(mod k*) we have h’ =2g’(mod k*), 
and it follows that 2’ — oxp{2rig’/k* —x/zk*}. Therefore, 


G(x) — 28W (h, k) exp{x(—2—2/z) /12k} F*(2’). 
If 2{% then 2? —exp{4rih/k—4rs/k}. From (2.2) we have 
G(z) <= 2(h, k) exp {x (1/22 — 22) /24k}H (exp {mil /k—m/zk})/E (X) 


where l 
(2.9) X = exp{2xiG’/k —r/22k}, 
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(2.10) 2(h, k) —x(h,k)/x(2h, k). 
Here, dA@®’=—1(modk). Since 2hH’=—1(modk) we have H’=2@’ 
(mod k), and it follows that X? = exp{?miH’/k—m/zk}. Since H(X*)/H(X) 
== G(X) we conclude that 

G(z) = 2(h, k) exp {a (1/22 — 22) /24k}G(X). 


With z, a’, X given by (2.5), (2.6), (2.9) respectively we combine these 
results to obtain 


THEOREM 1. G(x) satisfies the transformation equation 


G(z) = w(h, k)exp{x(1/z—z)/12k}G(2’) if 4] k, 
G(x) = AW (h, hb) exp {r(— 2 — 2/2) /12k} F(a’) tf k=? (mod 4), 
G(x) = z (h, k)exp(1/22— 22) /24k} G(X) if 24. 


3. Estimates of three exponential sums. In what follows we shall 
require estimates of the magnitudes of certain exponential sums involving 
w(h,k), W(h,k), and z(h,k). We first quote, with some minor notational 
changes, three pertinent results ((3.5), (4.11), (5.7)) from [2] concerning 
w(h,k) and x(h,k) as given by (2.3) and (2.4). 

If 4] % then 


(3.1) u(h,k) = exp{2ri($ (sh + th’) /Gk —84(c—2)/@)}. 


Here, if 3 | k then f—1, G= 48, while if 3k then f—3, G—16. ¢ is 
defined by the congruence fp==1(modGk), while hh’==-—1 (mod Gk). 
C= 1,3 according as h==1,3(mod4). Finally, 
s= 2h* — 6k —2, 
(3.2) 
t=k 22, 
If k=2(mod4) then 
(3.8) o(h,k) = exp{2rt(A(—h+ 2’) /Jk* 
+T(—12d(k + k*) + 4d + 6 —3h*) /e)}. 
Here, if 3 | k then e= 16, J = 3, while if 3{% then e=48, J=1. AandT 
are defined by the congruences ea=1(modJk*), Jk*T=1(mode), while 
hh’s=—1(modJk). d= +8 according as h= + 3(mod4). 
If 27% then 


(3.4) xCh, k) = exp{2xi(@(— 2h —W’)/gk + ¥(12 — 12k? + ka —6)/F)}. 
Here, if 3 | k then F=16, g —3, while if3 {f k then F=48, g-1. Sandy 
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are defined by the congruences F&==1(mod gk), gky=1(modF), while 
hh’ ==—1(mod gk). « is defined by ka= 1 (mod 4), 0<a<4. 

From these results, similar statements involving w(h,k), W (h,k), and 
z(h,k) can be derived. We consider four cases. 

If 8 | k, then 4 | &* and we have from (2.7), (3.1), and (8.2) 


(3.5) w (h, k) == exp{2aig (uh + vh’)/Gk}, 
where u == k? + 2, vy = Rh — 2. 

If &=4(mod 8), then k*=2 (mod 4) and we have from (2.7), (3.1), 
and (3.3) 
w(h, k) — exp (2xi( (sh + th’) /Gk—A(—h + W) /JK —64(c—2)/4 

—T(— 12d(k* + K) + 4d + 64* — 3k*?) /e)}. 

Here K= k*/2 = k/4. Since e=16f and G—16J the congruences fp =1 
(mod Gk) and a=1(modJK) imply that p ==16A (mod JK). If we define 
r by the congruence 16r=1(modJK) we see that A==r¢(modJK). Finally, 
since Gk == 647K, we have ' 


(3.6) w(h,k) —exp{2ni(g(uh + vk’) /Gk—64(c—2)/4 
—T(—124(k* -+ K) -4d -+ 6k* —3k*?) /e)} 
where u = 2k? — 6k — 3 +- 64r, v= k? +3 — 64r. 
If k= 2 (mod 4), then 2 fk* and we have from (2.8), (8.3) and (3.4), 
noting that e= F, J == g, X= b, T= y, 
(3.7) W (h, k) = exp{2ri (à (2h + 4h’) /Jk 
+T(—12d(k+ k*) + 4d—6k*a -+ 6)/6)}. 
If 2f k then from (2.10) and (3.4), 
z(h, k) = exp{2aib (2h —h’ -+ h*) /gk} 


where 2hh*==—-1(modgk). Since hk’==—1(modgk) we have h’==2h* 
(mod gk). If we define j by 2j==1(mod gk) then h*==jh’(mod gk). There- 
fore, 

(3.8) z(h, k) =exp{2ri® (2h — jh’) /gk}. 


We now state the main results of this section. 
THEOREM 2. The sum x w (h, kjexp{— mi (hn— ky) /k} where 
4 k 


h=d(mod4), 274; aSh’ <b(modk), OSa<bSk, 4|k is subject to 
the estimate 0(n/*k7/5+) uniformly in v, a, b, d. 
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Tuxrorem 3. The sum 3 Wih,k)exp{— ri(khn—h’v)/k} where 
hmodk 
k=d(mod4), 21d; aS’ <b(modk), OSa<bSk, k=2(mod4), ts 
subject to the estimate 0(n*/*hi/8) uniformly in v, a, b, d. 
Turorem 4. The sum X 2(h,k)exp{—2axi(hn—G’v)/k} where 
kmodk 
aS <b(modk), OSa<bSk, 21k ts subject to the estimate 0 (n/*k?/**) 
uniformly in v, a, b. 
Here hk =—1 (mod k), 4h@ =—1(modk) and $y indicates that h 
runs over a reduced residue system modulo k. Using (3.5), (3.6), (3.7), 


and (3.8) the proofs of these theorems are essentially the same as those of 
Theorems 2 and 3 in [1] and are therefore omitted. 


4. A convergent series and asymptotic formulas for Q (n). We now 
have the tools required for the determination of Q (n). The procedure followed 
in this section is that of Rademacher, and for the integration details the 
interested reader is referred to [6]. By Cauchy’s formula we have 


nf, 3G (2) de = ge WS era(a)ae 


where O<Sh<k=N and én are the Farey arcs of order N of C, the circle 
| z | = exp{—2rN*}. If on & we let z= exp{— rn N? -+ 2nih/k + rip} 
and write w == N? —i¢ẹ, ze wk we obtain 


O(n) = BY expf— Zrinh/k) ("6 (exp( rik /k —2r2/k) Jexp (ew) dp. 


Here g= 1/k(k + kı) and ß=1/k(k-+-k,) where hı/k, <h/k < h/b: are 
consecutive terms in the Farey series of order N. 

If we split the sum over % into three parts Q(n,1), Q(n,2), O(n, 3) 
according as k= 0,2, + 1(mod4) respectively, then 


Q(n) = (0,1) + O(n, 2) + O(n, 3). 
By Theorem 1, 


Q(n,1) = 3" w(h, k)espt—rinh/k) [SO (v)exp(2eib’y/e 


-exp{—(a/k?w) (2y —1/12) + mw(2nr — 1/12) }de 
where 4| k, kN. 
Splitting the sum over y into two parts according as y==0 or vy > 0 we find, 
employing Theorem 2, that 
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Und) = 2r BA (bm) L (ksn) + O(mTaN Un exp (2am) 


where 
(4.1) A(k,n) = = w(t, k)exp{— minh/k}, 
(4.2) L(k,n) = k> (24n — 1) 1I {x (24n — 1) 8 /6k}. 


Here I, (z) is the Bessel function of first order and 4 | k. 
Turning to Q(n,2) we have by Theorem 1 


Q (m, 2) = 2%!" Y W(h,k)espt—rinh/k) f° Se()explanikt/k) 
exp{(—(7/kw) (+ 1/6) + rw (2n—1/12)}dé, 


where k==2 (mod 4), kSN and where we have written F?(z) = Se(v)2". 
Since 2v -+ 1/6 > 0 we find, making use of Theorem 3, that á 


Q (n, 2) = 0 (n/N 8+ exp {2anN-*}), 
Again employing Theorem 1, 


O(m 8) = B (h, e)exp{—2rinh/k) (” 3.Q(vexp(2niGs/k) 


-exp{—(x/2h*w) (y—1/24) + mw (3n —1/12) jde 
where 2f k, kN. 
If we split the sum over y into two parts according as y—=0 or y>0 
we find, making use of Theorem 4, that 


Q(n, 3) 738 (k,n) M (k,n) + 0 (n!/aN-Here exp {2anN-*}) 


where 

(4.3) B(k,n) = 2 ah, k) exp{— 2xrinh/k}, 
(4.4) M (k,n) = kt (24n —1)-V0, fr (24n —1)¥2/12h}, 
and 2¢k.. 


Letting N>w we obtain 


THRoREM 5. 'Q(n), the number of partitions of a positive integer n 
into distinct odd positive summands is given by the convergent series 


O(n) = Pe 3A (k, n)L(k,n) +r ŽB (k,n) M (k,n), 


PARTITIONS INTO ODD AND UNEQUAL PARTS. 328 


where A, L, B, M are gwen by (4.1), (4.2), (4.3), (4.4) respectively. In 
the first sum 4 | k, in the second sum 27 k. 


As in the case of q(n) the dominant term in the series representing 
O(n) is that for which k ==1. Writing T=r(24n — 1)'/2/12 we have 


THEOREM 6. As n> 
Q(n) =r (24n — 1)" {T} (1 + 0 (exp{— cn/}) ) 
where c> 0. 
‘COROLLARY. As n—>co l l 
Q (n) = 643 (24n — 1) -3i exp{T} (1 + aa 


We omit the proofs of these results as they are very similar to those of 
Theorem 7 and its corollaries in [1]. 


`B, Concluding remarks. The results obtained in this paper can be 
translated into the language of modular forms. Thus, let T,(4) be the 
subgroup of the modular group consisting of those transformations . V (t) 
== (at-+b)/(et-+d) which satisfy the restriction 4|c. If c>£0 we can 
take c>0. If c=0 we have V(t) —=t-++0, with b an arbitrary integer. 
Thus, T,(4) contains the subgroup of translations generated by S(t) —¢ 4-1. 
The circles |et+d|—1 where c>0, 4] c, (c,d) <1, are the isometric 
circles of T,(4). It follows that that part of the strip 0 < R (t)<1 which is 
exterior to the circles | 4t—1]—=1 and |4— 3 | = 1 is a fundamental region 
for T,(4) with parabolic cusps at œ, 0, and 1/2. We also note that T,(4) 
is generated by the transformations $S=t-+1 and T = (3i—1)/(4t—1). 
With k > 0, 4 | k, hh’==—1(modk), define ¥—=— (hh’+1)/k. With 
R (z) > 0, but z otherwise arbitrary, t—h/k-+iz/k represents a complex 
variable with domain the upper half-plane. We easily verify that 


V(t) = (Wt 4K) /(kt— h) = W /k -+ iz/k. 


If we now define g(t) = exp{— 2nit/24}G(exp{2rit}), the first statement 
of Theorem 1 becomes 


g(V(t)) = {w (h, k) }* exp{2at(h—h’) /24k) 9(t), 


while with « == 23/24 we have g(t +1) =exp{2mta}g(t). Thus, g(t) is a 
modular form on T,(4) of dimension zero with multiplier system e given by 


e(h’,k',k,— h) 22 {uw (h, k)} exp{2ri (h — W)/24k} if k> 0, 
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and 
e(1,5,0,1) = exp{2riba}. 
The second and third statements of Theorem 1 give the behavior of g(t) at 
the parabolic cusps 1/2 and 0 respectively. 
Writing Q (0) =1 we have 


exp{—2riat} g(t) = È Q (m + 1) oxp(2eimt} 


so that the partition numbers discussed in this paper are seen to be the Fourier 
coefficients of the modular form g(t). In this setting the referee has pointed 
out that a weaker form of Theorem 5 is contained as a special case in a 
theorem due to Lehner (Theorem 2 in [5]). Lehner’s result, stated in our 
notation, is i 

Q (n) = m34 (k,n)L(k,n) +#2B(k,n)M(k,n) +0(1). 


In the first sam 4 |k, 4S&k<ß(n—1)"?. In the second sum 2f k, 
1k <B(n—1)**. B is an arbitrary positive constant. 
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PROPERTIES OF CERTAIN TYPES OF WILD SURFACES IN E’. 


By C. E. Burczss.* 


1. Introduction. Let S be a wild 2-sphere in Æ? such that S + Int S 
is a topological cube, and let W be the set of all wild points on 8. In Section 
3 we show that if 8, is a 2-sphere in 8 + Int S such that W C S,, then S, is 
wild at each point of W. Kinoshita [16] has announced the special case of 
this result where W is a point and 8; —-W C Int$. In Section 4 we show 
that if W is a subset of a tame Cantor set in E°, then there is a tame 2-sphere 
8, such that S-S,— W and 84 C S+-ExtS. Alexander [1] has given an 
example of S, known as a horned sphere, where the set W is a tame Cantor 
set, and Ball [3] has described a different such horned sphere. (The con- 
struction used by Ball can be changed slightly so that S + Int 9 is a topological 
cube.) Bing [10] recently has described an example of 9 similar to Alex- 
ander’s example so that W is a Cantor set in a plane P such that P-S—W 
and § can be pierced with a straight line interval at each of its points. By 
using a sphere similar to the one described by Ball, Fort [13] previously gave 
an example of a wild sphere S that can be pierced by a straight line interval 
at each of its points. His example can be modified slightly so that W is in a 
plane P such that P: 8 = W. Fox and Artin [14] have described an example 
of S where W is a point. 

Other examples where W is a subset of a tame Cantor set can be obtained 
in the following way from the above examples. Let K be a tame 2-sphere in 
E? and let W, be a closed subset of a Cantor set on K. Let D,,D.,--- bea 
sequence of disjoint disks in K — W, such that W, is the limiting set of this 
sequence and such that the sequence of diameters of D,,D,,' « - converges to 
zero. Now for each 1, replace D; with a disk R; which is wild on a subset W; 
of a tame Cantor set in E® and is locally tame elsewhere. This can be done 


so that (K — $ D:) + È F; is a sphere S and S+ Int is a topological cube. 
1 1 A 

The set W of all wild points on 8 is the set YW,. That W is a subset of a - 
o 

tame Cantor set can be seen by applying Bing’s theorem [7] that a Cantor 
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set C is tame in EF? if, for each « > 0, there exist a finite collection of disjoint 
spheres Kı, Ka, -.-,K, such that each K; has a diameter less than « and 


OCSE. 
ı 


In Section 5, we use the results about 2-spheres in Sections 3 and 4 to 
obtain some similar theorems for connected 2-manifolds in a 3-manifold. 

Most of the definitions used here will be similar to those used in [8] 
and [11]. We use “«disk”- to denote a disk with a diameter less than e. 
We use “e-neighborhood of a set Y” to denote the set of all points within 
a distance e of Y. If § is a 2-sphere in E®, we denote the bounded component 
and the unbounded component of #E°— 8 by “Intg” and “ Ext 8,” respec- 
tively. If D is a disk, we use “Int D” to denote D—BdD. 


2. Preliminary theorems. A simple closed curve is defined to be 
unknotted in E® if it is the boundary of a tame disk. We say that an open 
subset Y of a 2-sphere 8 can be uniformly locally spanned in a component V 
of #*—-§ if for each «> 0, there exists a §> 0 such that for any d-disk R 
in Y and for any positive number «, V contains a disk D with the following 
properties: 

(1) diamD<e, 

(2) there is a homeomorphism of Bd R onto Bd D ne moves no point 
more than a distance a. 


A complementary domain V of 2-sphere S in E? is locally simply connected 
at a point p of 8 if for each neighborhood N of p there exists a neighborhood 
U of p such that each map of a simple closed curve into U- V can be shrunk 
to a point in N-V. 


THEOREM 1. If J is a simple closed curve on a 2-sphere S in E? and 
V is a component of E°—S, then for each positive number e there is an 
unknotted simple closed curve which is in V and is homeomorphically within 
e of J. 


Proof. By Bing’s Side Approximation Theorem [9], there exists a poly- 
hedral 2-sphere 8’ and a finite collection D,, Da: - +,D, of disjoint e/2-disks 


on 8” such that S’ is homeomorphically within e/2 of 8 and S’—3S.D,C V. 
1 


There exists a simple closed curve J’ such that J’ C S’ and J’ is homeo- 
morphically within e/2 of J. Now there is a simple closed curve J” such that 


J” C S —SD, and J” is homeomorphically within e/2 of J’. Thus the 
2 
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unknotted simple closed curve J” is in V and is homeomorphically with e 
of J. 


THEOREM 2. Suppose I is a 2-sphere in E°, V is a component of E*—8, 
U is an open subset of S, and for each point p of U and each neighborhood N 
of p there ts a neighborhood Q of p such that each unknotted simple closed 
curve in Q-V is the boundary of a disk in N-V. Then V is locally simply 
connected at each point of U. 


Proof. Let q be a point of U and let H be a disk in U such that g € Int H. 
We will show that Int # can be uniformly locally spanned in V, and it will 
follow from Theorem 12 of [11] that V is locally simply connected at each 
point of IntH. (The proof of Theorem 12 of [11] is valid for either com- 
plementary domain of 8.) 

Let e be a positive number. It follows from the hypothesis that there 
exist open sets Y,, Fa’ © +, Yn covering H such that for each i (1Si=n), 
each unknotted simple closed curve in V- F; is the boundary of an e-disk in V. 
Now let ô be a positive number such that each $-disk in Int H is a subset of 
some Y;. Let K be a $-disk in Int H and let t be an integer so that K C Yı 
Let « be a positive number. It follows from Theorem 1 that there is an 
unknotted simple closed curve J in Y-Y, that is homeomorphically with a 
of Bd kK. As J is the boundary of an e-disk in V, we conclude that Int H can 
be uniformly locally spanned in V. Thus by Theorem 12 of [11], V is locally 
simply connected at each point of IntH. This implies that V is locally 
simply connected at each point of U. 


THEOREM 8. Suppose S and S’ are 2-spheres in E°, R is a disk on S, 
and D is a disk such that 


1) ’C8+In8 
(2) Ris locally polyhedral at each point of R— 9’ 
(8) DC Exts’ 
(4) BdDC Ex Ss 
(5) D-SCR, and 
(6) 3diam(D-+-R) < diam &. 
Then for each positive number e there is a disk D’ such that 
(1) Baly’—BdD 
(2) D C Ext 8, and 
(3) D’ is in an eneighborhood of D + R. 
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` Proof. By Bings Approximation Theorem [4; 9], we assume that D is - 
locally polyhedral at each point of Int D. Since in any neighborhood of 
E-D, D can be moved slightly to obtain a disk that is in general position 
with R— 8’, we assume that D is in general position with R— S’; that is, 
we assume that each component of D-R is a simple closed curve J such that 
any two points near J, and in different components of D— J, are in different 
components F*— 9. Also, we assume that if X is a disk satisfying all of 
the requirements in the hypothesis and the above requirements of D such that 
BdX—BdD and X is in an e-neighborhood of D -+ R, then the number of 
components of X-8 is not less than the number of components of D-S. We 
wish to show that these assumptions, together with the requirements in the 
hypothesis, imply that D C Ext S. So suppose that D intersects 8. 

Each component of D-Int O separates Int $ into two connected sets E 
and Æ such that the boundary of one of them, say of F, is in D-+-R. 
Now by using the hypotheses that 3 diam (D+ BR) < diam 8’ and DC Ext 8’, 
it. follows that the closure of E does not intersect S. 

We will show now that no component of D-(S+Int8) is a disk. 
Suppose some such component Y is a disk. Then there is a disk W on R 
such that W -+ Y is a sphere which, according to the paragraph immediately 
above, contains no point of S’. Hence W is a polyhedral disk as it is in 
R— 58’. Let C be the component of D—W that contains BAD, and let 
Ly, La © +, Ly denote the simple closed curves in W that are subsets of the 
boundary of C. We consider these simple closed curves to be ordered so that 
if j >i, then Z, is not in the disk in W that has L; as its boundary. Now 
by following a procedure described by Bing [8, p. 297], we can obtain 
a disk D’ which is a subset of C+ (an e-neighborhood of W) such that 
8:D’CD-(8—W). This is contrary to the supposition in the first para- 
graph, as 8- D’ does not contain BAY and hence S- D’ has fewer components 
than S-D. Thus no component: of D-(S9+-IntS) is a disk. 

Now we will show that there is a subdisk D, of D such that D,-IntS is 
a component of D-Int§ and each component of IntD,—Int$ is a disk 
in §-+ Ext 8. There exists a disk Z, in D such that IntZ, is a component 
of D—8. It follows from the preceding paragraph that IntZ, is a subset 
of Ext, so some component of D-9 separates Z, from BdD in D. This 
implies that there is a disk Y, in D such that Bd F, CR, Z, C tY, and 
some component X, of Y,- Int S has both BAY, and BdZ, on its boundary. 
Thus each component of IntY,—X, is a disk, so suppose that some com- 
ponent T, of Int Y, —X, is not in S 4+ Ext 8. It follows that there is a disk 
4, in IntT, such that Int Z, is a component of 7,—S and Z, C 8 + Ext S. 
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‘Now there exists a disk Y, in T, such that BAY, C R, Z, C Int Ys, and some 
component X, of Y+: Int S has both Bd Y, and Bd Z: on its boundary. This 
procedure can be continued a finite number of steps to obtain a disk D, 
promised in the first sentence of this paragraph. 

Let J, denote the boundary of D,, let Ja, Jas’ © -,Jm denote the com- 
ponents of 8 -Int D,, and for each ¢ (2 Si= m), let D; denote the disk in D, 
that has J; as its boundary. Also, for each # (1Si=m), let R; denote the 
disk in Æ that has J; as its boundary. Let U denote the component of 
Int S— D, that does not intersect 8’. There are two cases to be considered, 
depending upon whether points of Int R, near J, are on the boundary of U. 


Case 1. Hach neighborhood of each point of J, contains a point of 
Int R, that is on the boundary of U. Let K denote the component of Ri: Bd U 
that contains Jı. Since each component of BdK is some J, assume for 
convenience that J1,Js,--+,/, are the components of Bd KX. Let R’ denote 
the polyhedral disk K 4+-D,+D,+----+D,, and let H denote the com- 
ponent of D— E that contains BdD. It follows that HC D—D,. Let 
Lı, Da,’ + -,L, denote the simple closed curves in R’ that are subsets of the 
boundary of H, and assume that these simple closed curves are ordered so 
that if j > 4%, then L; is not in the disk in R’ that has L; as its boundary. 
Notice that each L; is a subset of S. Using the fact that R’ is a subset of 
£-+D-¥Ext§ and does not intersect 8’, we can apply induction to obtain 
disjoint simple closed curves L,’, L,’,---, Lr in D, disjoint disks Ha, Hacet, He 
in D, and disjoint disks H,’,H,’,- - +, Hy in ExtS such that for each i, 

(1) ZL C Ext 8, 

(2) I,-+L/ is the boundary of an open annulus in D-ExtS, 

(3) L/—BdH,;—Bd Hf, 

(4) Hi is in an eneighborhood of R’, and 


(5) (D-H) + 3H is a disk D. 


Now S-D' C SD and D’ is in an e-neighborhood of D +R. But D’ does 
‘not .contain J. 1, 80 we have the contradiction that S- D’ has fewer components 
than 8-D. 


Case 2. Hach neighborhood of each point of J, contains a point of S—R, 
that is on the boundary of U. From requirement (6) of the hypothesis and 
the requirement that U contains no point of S’, it follows that BAU is a 
subset of D+ R. Hence for some i (2 Sim), J; separates BAR from J, 
in R. For convenience, assume that J. separates Bd # from J, in R and 
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that for each 1 (3Si=<m), J; does not separate J, from J, in R. It follows 
that some component K of R- Bd U contains both J, andJ;. For convenience, 
assume that Jı, Je," * ',J„ are the components of Bd kK. Let R’ denote the 
polyhedral disk K+ D.+D,+---+D, Now BR’ CR+D-ExtS and 
does not intersect 9°. As in Case 1, we can obtain a disk D’ such that Bd D’ 
=: Bd D, D’ is in an e-neighborhood of D + R, §-D’ C 8-D, and D’ does not 
contain Jı. Thus we have the contradiction that S- D’ has fewer components 
than 8-.D. 


3. Spheres which intersect at their wild points. A 2-sphere S in E® 
is defined to be locally tame at a point p from a component V of E®—8 if 
there exists a subset U of S + V such that p€ U, U is open relative to 9 + V, 
and the closure of U is a topological cube. Some conditions under which a 
surface is tame from one of its complementary domains are given in [11]. 


THEOREM 4. Suppose 8 and 9’ are 2-spheres in E®, p is a point of 8-8, 
and Y is an open subset of S such that 


(1) per 

(2) 9°C9+Int$ 

(3) 8” is locally tame at p, and 

(4) -S is locally tame at each point of Y — D. 


Then § is locally tame at p from Ext S. - 


Proof. There exists a tame disk K’ on. 8” such that pe Int K’. Let K be 
a disk on § such that pe Int K, K C Y, and 9’ -Int K C Int X’. We will show 
that Ext S is locally simply connected at each point of Int K, and this will 
imply that 9 is locally tame from Ext 8 at each point of Int K [11, Theorems 
1 and 2]. 

Let q be a point of Int K and let N be a neighborhood of q such that 
3 diam N < diam 8’. For convenience, we assume that K’ is a polyhedron 
and that each of the disks K and K’ is a subset of N. Let U be a spherical 
neighborhood of g such that U C N, U-S C K, and U-S’ CK’. Let J be 
an unknotted simple closed curve in U-ExtS8.. Thus J is the boundary of 
a disk Din U. By applying Bing’s Approximation Theorem [4; 9] we can 
assume that D is locally polyhedral at each point of IntD. Furthermore, 
since K” is a polyhedron and D- 8’ C K’, we can follow the procedure described 
by Bing [8, p. 297] to adjust Int D so that D C N-Ext§’. Also, since 8 
is locally tame at each point of Y— S’, we can assume that 9 is locally 
polyhedral at each point of Y — S’ [18; 5]. Now it follows from Theorem 3 
that there is a disk D’ such that Bd D’—BdD and D’ CN-ExtS.° Thus 
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we have shown that J is the boundary of a disk in N-Ext 8. It follows from 
Theorem 2 that Ext S is locally simply connected at each point of Int K. 


THEOREM 5. Suppose 8 and S’ are 2-spheres in E, W ts the set of all 
wild poinis of S, S-+IntS is a topological cube, and WC S&’ C S+ Int. 
Then 8’ is wild at each point of W. 


Proof. Suppose that 9’ is locally tame at some point p of W. By 
Theorem 4 and the hypothesis that S-+-IntS is a topological cube, this leads 
to the contradiction that $ is locally tame at p. 


4, Spheres which are tame except on a subset of a tame Cantor set. 
By considering the theorems of this section and the examples in references 
cited in Section 1, it can be seen that Theorem 5 does not hold true without 
the requirement that S -+ Int8 is a topological cube. Similarly, it follows 
from Theorem 5 that the theorems of this section do not hold true without 
this requirement. Theorems 6, 7, and 8 do not hold true without the require- 
ment that W, the set of all wild points of 9, is a subset of a tame Cantor 
set. Antoine [2] has described a 2-sphere S so that W is a wild Cantor set 
and S-+IntS is a topological cube, and some examples where W=S and 
S-+-IntS is a topological cube have been described by Bing 16] and 
Martin [17]. 

We say that a 2-sphere S in F° can be locally spanned at the N p 
from the component V of E°—S$ if, for each positive number e, there exist 
disks D and R such that (1) p€ Int E C 9, (2) ntDCV, (8) BAD—BdR, 
and (4) diam(D-+R)<e We say that S can be locally spanned if it 
can be locally spanned at each of its points from each component of E? — 8. 
Such a sphere is tame in F? [11]. 


THEOREM 6. If S is a 2-sphere in E? such that 8 + Int 9 ts a topological 
cube and the set W of all wild points of 8 is a subset of a tame Cantor set 
in HS, then there exists a tame 2-sphere 8’ such that S C S+ Ext S and 
8:8’ = 

The following lemma will be used in the proof of Theorem 6. 


Lemma 1. If S and W satisfy the hypothesis of Theorem 6 such that 
8 is locally polyhedral at each point of S—W, then for each «>0 there 
exist disjoint polyhedral 2-spheres Kı, Ka: © +, Kn with disjoint interiors 
such that 
(1) WCDntk, 
1 


(2) each Ki Ext S ts connected, 
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(3) each component of each Ky (S + Intg) is a disk, 
(4) each K, has a diameter less than e. 

(5) each Int K,-ExtS is connected, and 

(6) each Int K, intersects W. 


Proof of Lemma 1. Let § be a positive number such that § <e/3 and 
each subset of 8 of diameter less than 8 lies in an «/3 disk on 9. Since W 
is a subset of a tame Cantor set, there exist disjoint polyhedral 2-spheres 
H,, Ha’ + -,;H, with disjoint interiors such that each H; has a diameter 


less than § and WC S Int H; [7]. We assume that each H, is in general 
1 i 
position with S—W. Each H,-ExtS has only a finite number of com- 


Er 
ponents, so let H,,F,,:--,#, denote the components of Ext$:3H,. For 
1 


each ¢ (LSi<r), the boundary of E, is a subset of some «/3-disk D; in 8 
and is the sum of a finite number of simple closed curves in S—W. Using 
the hypothesis that 8 -+ Int Sis a topological cube, we can follow the procedure 
described by Bing [8, p. 297] to obtain, for each i (1SiSr), disjoint poly- 
hedral disks Du, Dis, © +, Dir, such that (1) each Int Dy is a subset of Int 8, 
(2) each Dy is in an e/3-neighborhood of D,, and (3) the set F; + Da + Dy 
+--+ -Din is a polyhedral 2-sphere K; The above procedure can be followed 
so that Kı, Ko, + +, K, are disjoint. For convenience, assume that each Int K; 
intersects W. 


Now we will show that W C Slat K, Suppose that some point p of W 
is not in Sint K, Let q be a Si in Ext that is in neither of the 


sets $ (Kı+IntK,) and X (H; + Int H). There is an arc pg such that 
š 3 . ı 

pg—pCExtS, pq is locally polyhedral at each point of pg—g, and 

pq 2 Ks is finite. Furthermore assume that no other such are from p to q 


intersects IK, in fewer points than does pg. As pe Š Int Hs, it follows 


that pq intersects one of the sets #,,H,,:- -, En Consider the case where 
pq intersects #,. Both p and q are in Ext Ki, so let X and Y be the com- 
ponents of pg: Ext K, that contain p and q, respectively. Let x and y be the 
points of Æ, that are limit points of X and F, respectively. Since F, is 
connected, there is an are Z in F, such that + y CZ. Let U be a connected 


open set which contains Z and does not intersect S+>K, There is an 
` 2 x 
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arc A from p to q such that AC X +Y +U, A C Ext K,, and A is locally 
polyhedral except at p. This involves the contradiction that there are fewer 


r r r 
points in A- X, K; than in pqg: > K,. Hence we have shown that W C YInt K. 
a 1 1 
As at least one of the 2-spheres Kı,Ka' ‚Kr is not a subset of 
S Int Ki, assume for convenience that no one of the spheres Kı, Ka © 0, Kn 
1 


is a subset of S Int K, and that each of the spheres Kun, Kna + +, Kr is 8 
1 


r 
subset of $ Int K;. It follows that the spheres Ki, Kz,- - -,K, satisfy the 
1 


requirements in the conclusion of Lemma 1. 


Proof of Theorem 6. If T is a polyhedral annulus and the simple closed 
carves J and J’ are the components of the boundary of T, we call T a tube 
from J to J’. 

Let So be a polyhedral 2-sphere such that SC Int So Let Kis, Kis, 
- + +,Kin, be polyhedral 2-spheres which satisfy the requirements of the con-- 
clusion of Lemma 1, where e=1, such that each Kı; C Int 8o Let Du, Dis, 
+++, Dım be disjoint polyhedral disks on 8, and for each j (1Sj=n,), 
let Ry be a polyhedral disk in Int Ky: Ext S. For each j (17 <n,), there 
exists a tube T,,; from Bd D,, to Bd R,; such that 


(1) Tij—Bd Dy C Int 8.: Ext S, 
(2) T'K is a simple closed curve Ly, 
. (8) Ty does not intersect Int R,, and 
(4) Tı does not intersect Kır, where r 34 j. 


Furthermore, we require that these tubes be disjoint. Let S, denote the 
polyhedral 2-sphere 


(So— È Dy) HÈ Tyt D Ry. 


Notice that for each j (1S jim), 81: Ky = Ly. 

Now let K2, K32,' ' ',Kgn, be polyhedral 2-spheres which satisfy the 
requirements of the conclusion of Lemma 1, where e= 1/2, such that each 
K+ is in Int 8, and is in some Int Ky. There exist disjoint polyhedral disks 
Da, Daz, © +, Don, disjoint polyhedral disks R, Res,‘ © >, Ran, and disjoint 
tubes Tz, Ton © -, Ton, such that for each j (1S jin), 


(1) Dis a subset of some Ry, 
(2) Ry C Int Ky Ext 8, 
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(3) Ty is a tube from Bd Dy to Bd Ray, 

(4) Ty is in some Int K, 

(5) T does not intersect Int Rz, 

(6) Ty—BdD, C Int 8,- Ext 8, 

(7) Ta does not intersect Ka, where rj, and 
(8) Ta’ Key is a simple closed curve Laj 


Let Sı denote the polyhedral 2-sphere 


(I —XD,;,) +E Ty + È Rey. 


By use of induction, this process can be continued to obtain a sequence of 
polyhedral 2-spheres So, S1, S3,- - - that converges to a 2-sphere S’ such that 


(1) S’-S—W, 

(2) g C 8-4 Exts, 

(3) for each >21, S D Sa — (Da + Die +: < -+ Din), and 
(4) each Ky has a diameter less than 1/1. 


Thus 9’ is locally polyhedral at each point of S’—W and each Ky: 8’ is a 
simple closed curve Laj. 

It remains to be shown that 8° is tame, and in particular, that 9’ is 
locally tame at each point of W. Let p be a point of W and let 8 be a positive 
number. There exists an integer i such that 1/i <8 and there exists an 
integer j such that pe IntKy. Since Ky: S’—Ly, it follows that 8° can 
be locally spanned at p from each component of E3— 9’. Thus 8” can be 
locally spanned at each of its points. It follows from [11, Theorem 8] that 
8’ is tame. 


Taeorem 7. If Sts a 2-sphere in F° such that 9 + Int 8 is a topological 
cube and the set W of all wild points of S is a subset of a tame arc in E®, 
then there exists a tame 2-sphere 8’ such that 8’ C 8 + Ext S and 8: 8 = W. 


Proof. Let H be a tame arc in Æ? such that W C H. Suppose that W 
is not a subset of a Cantor set in H. Then some open interval E in H is a 
subset of W. Let U be an open subset of 8 that intersects L and contains 
no point of H— L. Then 8 is locally tame at each point of U—-L, and 
there is a tame arc K in L-U. It follows from a theorem proved by Doyle 
and Hocking [12] that S is locally tame at each point of K. But this is a 
contradiction as K C W. Hence W is a subset of a tame Cantor set in H. 
The conclusion of Theorem 7 now follows from Theorem 6. 
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THEOREM 8. If S ts a 2-sphere in E? such that S + Int S is a topological 
cube and the set W of all wild points of S is a subset of either a tame Cantor 
set or a tame arc in E®, then there ewisis a plane P in E? and a homeo- 
morphism h of E® onto itself such that P-h(S)—h(W) and h(W) is a 
subset of a straight line in P. 


Proof. As shown in the proof of Theorem 7, W is a subset of a tame 
Cantor set in E. Follow the procedure in the proof of Theorem 6, where 
the tame sphere S, is replaced with a plane P, that does not intersect 9, to 
obtain a tame topological plane P” such that S- P’==W. Let k, be a homeo- 
morphism of E® onto itself that carries P’ onto a plane P. As shown by 
Moore and Kline [19], h (W) lies in an are H in P. (Also, see Moore’s 
remark [20, p. 380] about an earlier proof by Shoenflies.) There is a 
homeomorphism hz of E, onto itself such that ho(P) =P and h,(H) is a 
subset of a straight line in P. Then hah, is a homeomorphism satisfying the 
requirements in the conclusion of Theorem 8. 


5. Generalizations to 2-manifolds in a 3-manifold. Let M be a con- 
nected 2-manifold in a triangulated 3-manifold M* such that M®—M is the 
sum of two connected sets V, and Va. The manifold M can be defined to 
be locally tame from V, at a point p of M by using the definition given for a 
2-sphere in Section 3. We say that M is tame from V, if M is locally tame 
from V, at each point of M. This is equivalent to saying that M+ F, is a 
3-manifold with boundary. 


THEOREM 9. Suppose M and M’ are connected 2-manifolds in a triangu- 
lated 3-manıfold M°, p ts a point of M-M’, and Y is an open subset of M 
such that 


(1) per, 
(2) W is locally tame at p, 
(3) M is locally tame at each point of Y—M', 
(4) M°’—M is the sum of two connected sets V, and Va, 
(5) M°—M’ ts the sum of two connected sets, and 
(6) MCVi+M. 
Then M is locally tame at p from Vz. 


Proof. As the connected set Va does not intersect M’, it follows that 
there is a component V of M*— W such that V C V, and WY CM-T. 
Let N be a neighborhood of p that is homeomorphic with Z®, and consider 
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N to have a triangulation derived from the given triangulation of M®. By 
a modification [11, Theorem 1] of a theorem proved by Bing [8, Theorem 5], 
there exist a disk D and a 2-sphere 8 such that 


(1) SCH, 

(2) pelnutDCY-S8, and 

(3) pis on the boundary of some component X of V,-Int8, where 
Int § denotes the component of M®— 8 that is a subset of N. 


Let U be an open set in N that contains p such that U-V,—=U -IntS=U-X 
and U-M—U-S==U-IntD. There exists a disk D’ in U-M’ such that 
pe IntD’ and W’ is locally tame at each point of D”. Thus there exists a 
disk D” in U such that Int D” C V and BdD”—BdD’. Let S denote 
the 2-sphere D’+-D”. Then ped’, ’CM--V, and 8:8 um DD. As 
IntD’ CU-VCU-V,=U-IntS, it follows that S C §+IntS. Thus 
8 and S’ satisfy the requirements of the hypothesis of Theorem 4, where F? 
is replaced with N. Hence by Theorem 4, 8 is locally tame at p from 
N— (8+Int$). This implies that M is locally tame at p from V.. 


THEOREM 10. Suppose M and M’ are connected 2-manifolds in a iri- 
angulated 3-manifold M? such that 


(1) M®—M is the sum of two connected sets V, and Vz, 
` (2) M ts tame from Vi, 
(3) M®—WM’ ts the sum of two connected sets, 
(4) M’CM-+Y19,, and 
(5) WCM-M’, where W is the set of all wild points of M. 


Then M’ is wild at each point of W. 


_ Proof. Suppose that M’ is locally tame at some point p of W. By 
Theorem 9 and requirement (2) of the hypothesis, this leads to the contra- 
diction that M is locally tame at p. 

The following theorem, which is a direct corollary of Theorem 10, is 
similar to a theorem proved by Hosay [15]. His requirement that the set 
of all diameters of components of M- M’ has a positive lower bound is omitted, 
but we add the requirement that M is tame from V;. That it is necessary 
to add this requirement can be seen by applying Theorem 6 to some examples 
in references cited in Section 1. 


THEOREM 11. Suppose M and M’ are connected 2-mantfolds in a tri- 
angulated 3-mansfold M? such that 
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(1) M®—M is the sum of two connected set V, and Vs, 
(2) M is tame from Vi, l 

(3) M®—M’ is the sum of two connected sets, 

(4) M is locally tame at each point of M—M’, 

(5) MCM+Y9;, and f 

(6) M’ is tame. 


Then M is tame. 


We define a Cantor set C to be tame in a 3-manifold M® if there is a 
homeomorphism of M? onto itself that carries O into a polygonal arc. 


THEOREM 12. Suppose M is a connected 2-manifold in a triangulated 
3-manifold M®, M®’—M is the sum of. two connected sets V, and Va, M is 
tame from V,, and the set W of all wild points of M is a subset of either a 
tame arc or a tame Cantor set in M?. Then there is a tame 2-sphere S such 
that SC M+V, and S-M—=W. 


Proof. As in the proof of Theorem 7, W is a subset of a tame Cantor 
set in M3. Let 8, be a tame 2-sphere in V}. The procedure in the proof of 
Theorem 6 can be followed to obtain a tame 2-sphere 9 such that SC M + FY: 
and §:-M— W. 
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STRONGLY NON-LINEAR PARABOLIC BOUNDARY VALUE 
PROBLEMS. 


By Farr E. Browprr.* 


- In a number of recent papers, the writer has developed a new non-linear 
version of the orthogonal projection argument to prove the existence of solu- 
tions of variational type for boundary value problems for non-linear partial 
differential equations, first for non-linear elliptic equations in [2], [3], [4], 
[5] and [6] and more recently for non-linear parabolic equations. This new 
method is based on general theorems assuring the existence of solutions of 
non-linear functional equations in Hilbert spaces and reflexive Banach spaces 
involving operators satisfying very weak continuity conditions but having 
suitable monotonicity properties? Our results in [6] included much stronger 
versions of results of M. I. Visik ([12], [13], [14]) on solutions of are 
elliptic boundary value problems for equations of the form 


a) ° Aum Z Deuda(t,¥,% - +, Dry) =f(z), 


with Aa having polynomial growth in (u, --,D™u).® In the parabolic case, 
we treat mixed initial-boundary value problems for equations of the form 


(2) FE tt. È, tbat, tity . ei: 


It is our purpose in the present paper to give a complete treatment of 
the parabolic problems for the case where the Aa have polynomial growth in 
(u,---,D"u). This treatment is based on a new and sharper theorem on 
non-linear functional equations in reflexive Banach spaces, Theorem 2 below, 
which contains as special cases the abstract theorem established in [6].* 
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The author is a Sloan Fellow. 

* Earlier but weaker results on continuous monotone functional equations were 
obtained by Vainberg and Kachurovski [11] and G. J. Minty [10]. 

* For the case where the Ag have linear growth and A is the set of Euler equations 
of a regular variation problem, an interesting generalization of Morse theory applying 
to solutions of the system (1) has been obtained recently by S. Smale and R. Palais. 

‘ After the preparation of the present paper was completed, the writer has learned 
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The principal results of this paper have been announced in [8].° 

Section 1 presents the formulation of our non-linear parabolic boundary 
value problems of variational type and states our main existence theorem, 
Theorem 1. In Section 2, we state and prove the basic abstract result, 
Theorem 2. In Section 3, we prove Theorem 1 using Theorem 2. 


Section 1. Let Q be an open subset of the Euclidean space R”. The 
points of Q will be denoted by z= (a,,- - -,2,) and derivatives with respect 
to the z-variables by 


1 4 
=F >} < 
D; i ia? ieS n, 


De = D. - + D,% if a — (0,° . "san)s 
FE 
[a] = day. 
j=l 
Late, a 
The points of R* will be denoted by ¢ and differentiation in # by ae 


We shall write integrals in Lebesgue n-measure over N as ff (x) de. 
By functions, we shall. mean r-vector, functions u= (ta,' * ', u+) for 
some fixed r>1, where each u, is a complex valued function on Q or on 
OX 8 where SC Rè. Thus Deu = (Deu, - +, D*u,), (Se = 
If u and v are two functions on 2, we shall denote by <u,v> their inner 
product in L? (O) i.e. 
<u, v = 2 fu,(2)d,(z) da, 


(even when neither function lies in L?(N), as long as the integrals converge.) 
Let S == [to, t1] be a closed line segment in Rt. Let A(t) be a system 
of partial differential operators on Q with coefficients depending on ¢ in Rt, 
of the form 
(1.1) A(t)u= 3 D*Aa(z,t,u,- --,D™u) 
lalam 


of papers of Visik, Dokladi A. N. S.8.S.R., vol. 140 (1960), pp. 998-1001 and Mat. 
Sbornik, vol. 59 (1962), pp. 289-335, which extend the results of [12], [13], and [14] 
to parabolic initial value problems with lateral Dirichlet boundary conditions. As in 
the elliptic case, Visik’s methods are more concrete-analytic than those of the present 
paper. A detailed account of his elliptic results under weaker hypotheses than those of 
[12], [13], and [14] has been published by Visik in Trudi Mocovskogo Hatematiceskogo 
Obétestoa, vol. 12 (1963), pp. 125-184. 

"The present paper is an amalgamation of the two papers listed as [7] and [8] in 
the bibliography of [8]. 
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where each A. is an r-vector function of (x,t) in Q X F+, of the value of the 
r-vector function u at (x,t), and the values of all the derivations DPu for 
[8|m. We assume the following about A(t): 


Assumption (I). Hach Aa is measurable in all variables and continuous 
in (u, -,Dru). 

For a fixed p>1, there exists a constant C>0 and a function 
geLe(QX RB), where g=p(p—1)", such that for all (z,t) in Q X Bt 
and each complex vector {== {tg;| 8 |S m} 


| a(z, t, €)| sC 2 | &e [= + g (z, t). 
lelsm 


Let p be the exponent of Assumption (I), W?(Q) the Banach space 
defined by 
WP (Q) = {u | u € Lr (Q), Due L*(Q) for |8| Sm}, 
with norm 
lu lmp={ Z || Deu Prr}? 
[slam 


W?(0) is a reflexive separable Banach space, since it has a natural embedding 
as a closed subspace of the direct sum of a finite number of copies of Le (0). 

Let V be a closed subspace of W?(Q) with C.” (Q) C V, where Ce” (Q) 
is the family of infinitely differentiable functions with compact support in Q. 
We consider the Banach space DS, V) of equivalence classes of functions u 


from 8 to V with A lult)]onsdi<+o. The norm in this Banach 


space is 
= fu Pao de 


Le (S, V) is itself a reflexive separable Banach space. 
It follows from Assumption (I) on the system A(t) that for every u 
and v in L? (S, V), the non-linear Dirichlet form h(u,v) is well-defined by: 


Definition. For u, ve L*(8,V), 
ti 
1.2 h = al‘ ee oe m a, z 
12) Aw) 2 S, lala, tult), : -,Dru(t)), Dov(t)y dt 


We know moreover from Assumption (I) that for a suitable constant 
c>0 
(1.3) . [awo Selo {Jul +1} 
for all u,v € L?(9, F). 
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Definition. Let 


FP={v|velr(S,V), v is continuous from S to V, piecewise con- 
tinuously differentiable from S to L9(Q)} 


Fy == {v | vE F, v(t) =0} 
F, = {v | vE F,v(t,) =0}. 


If (u,v) is the sequilinear form defined for u in Fo, v in Le(S, V) by 


4 du 
(1.4) Ku) f Od 
then for all v in Lr (S, V) and each u in Fy, 
uno) SC). 


i.e. l is a bounded conjugate linear functional of V. 

Let (Le (9, V))” be the conjugate space of Le(S, F), i.e. the space of 
bounded conjugate-linear functionals on Le (9, V). For u in L°(8,V), w in 
(L? (9, V))*, we denote the pairing of w with u by (w,u). This latter form 
is therefore linear in w, conjugate-linear in u. 

Definition. $, is the linear mapping of F, into (Le (8, V))* such that 
for each u in Fo, Sou is the element of (L°(8,V))* for which all v in Lr(8,V) 


(1.5) (Bu, 0) = (u, v) = J< E(t), 0(#)> dt 
Similarly 8, is the linear map of F, into (L°(8,V))* such that for each 
u in F,, dıu 18 the element of (L°(S,V))* for which for all v in L°(S,V),’ 
t du 
(1.6) (3,u, 0) = — Í. < F(t), v(t) de. 


We consider both & and 8, as operators with dense domains in Lr($, r) 
and ranges in (L°(S, V))*. 


Lemma 1.1. 8, C (8)*. 
Proof. Integration by parts. 


Definition. & is the closure of d, as a linear operator with domain in 
L°(8,V) and range in (L?(8,V))*. 


We know that 8, is closable and hence 8 is well-defined since by Lemma 
(1.1), 8 has a densely defined adjoint. 
Let us now formulate the boundary-value problem which we shall solve, 
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ürst in a heuristic classical analytic form and then in the precise form of 
the variational boundary value problem. 


Classical parabolic boundary value problem: Given f on OX S, to find 
u in O™(Q X 8) such that 


+A (tum f(x, i), t> to 
u(t) € V,t> to l 
(1.7) <A(t)u(t),v> ~ oe de t,u(t),- © -,D™u(t), Dv 
for all ve F, t> 0. 
u(t) = 0. 


We observed that every solution of the classical parabolic boundary value 
problem is also a solution of the following variational parabolic boundary 
problem: 


Variational parabolic boundary problem: Given f in (Lr(8,V))*, to 
find u in Lr(8,V) with we D(8) such that 
(1.8) (du, v) +h(u,v) = (f,) 
for all v in L°(8,V). 
Our basic result is the following: 


THEOREM 1. Suppose A(t) satisfies Assumption (I) and both of the 
following conditions are satisfied: 


a) For all u and v of L°(8,V), 
Re{h (u, u—v) —h(v, u—v)} 20 

b) There exist a non-negative function c(r) with 
c(r)— +% as r—>+to such that 

(1.10) Reh(u,v) 2c(Jul)i ell 

for all u in L*(S,V). 


Then there exists one and only one solution of the variational boundary 
value problem for the parabolic system 


(1.9) 


Aluf 


for gwen f in (L9(8,V))*. This solution u is continuous from 8 to IP (Q) 
and u(t) =0. 


7 
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The proof of Theorem 1 rests upon the following theorem on non-linear 
functional equations in reflexive Banach spaces. 


THEOREM 2. Let X be a reflective separable Banach space, X* sts con- 
jugate space, (w, u) the patring between elements w of X* and u of X. 
Let T be an operator, not necessarily linear, with dense domain D(T) in 
"X and range R(T) in X*. Suppose that T — L+ G, where: 


a) L is a closed densely defined linear operator from X to X* such 
that if L* is its adjoint operator (also acting from a dense domain in X 
to X*) and if W=D(L)ND(L*), then L is the closure of its restriction 
to W and L* is the closure of its restriction to W. 


b) G is an operator from X to X* defined on all of X, maps bounded 
sets of X into bounded sets of X*, and is demi-continuous, (i.e. continuous 
from the strong topology of X to the weak topology of X*). 


c) There exists a completely continuous mapping C of X into X* such 
that for all u, v of D(T) 


(1.11) Re(Tu—Tv,u—v) >) | 


d) There eatsts a continuous real-valued function c(r) of the real 
variable r with c(r) > to as r—>-oo, such that for all u in D(T), 


(1.12) Re(Twu) 2e(}ul)iial. 


Then T is onto X*, i.e. for every w of X* there exists u in D(T) such 
that Tu =w. 


The proof of Theorem 2 is given in Section 2, that of Theorem 1 in 
Section 8. We observe that our present Theorem 2 includes as a special case 
Theorem 2 of [6]. , 


Section 2. We now proceed to the proof of Theorem 2 which is based 
on the series of Lemmas which follows: 


Definition 2.1. Let T be a mapping with domain a linear subset 
D(T)C X, and range in X*. Then T is said to be hemt-continuous if T is 
continuous from every closed line segment in D(T) to the weak topology 
in X*. 


Luma 2.1. Let T be a hemt-continuous mapping from the dense linear 
subset D(T) of x to X*. Suppose that for some u, in D(T) and w in X*, 
we have 
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(2.1) Re(w— Tu, w—u) Z0 
for all u in D(T). 
Then w= Tuy. 


Proof of Lemma 2.1. Suppose w—Tu,~0. Then there exists v in 
the dense subset D(T) such that 


Re(w— Tus, v) > 0. 


Let u= ust tv for t>0. Then wED(T) for all t and replacing u in 
inequality (2.1) by us we have 0 Re(Tu,—w, tv) = t Re(Tu;—w,). 
Cancelling t, we have l 
Re(Tu;— w, v) Z0. 
We rewrite this as 
Re(Tus— Tuo, v) Z Re(w— Tus v). 


Letting ?—>0, the lefthand side goes to zero by the hemi-continuity of T. 
Hence 


0 = Re(w— Tuo v) > 0, 


which is a contradiction. Q.E.D. 
Lemma 2.2. Under the hypotheses of Theorem 2, R(T) is closed in X*. 


Proof of Lemma 2.2. Let {ux} be an infinite subsequence from X such 
that Tu,—> w strongly in X*. Then | Zu, || SM, for all k. Further, 


| Re (Tür, ux) 2 o (f ux ||) | % |; 
while 
Re (Tur ux) S || Tue ||- | we || S Mo || ux |. 
Thus 
lu ||) SM 


and since c(r) ->œ as r—>-t-oo, || uz || <M. Since Œ carries bounded sets 
in X into bounded sets in X*, we know that || Gus | SM.. Replacing {ux} 
by an infinite subsequence if necessary, we may assume that u,— u, weakly in 
X, Gur —> v, weakly in X*. Hence Lurs = Tu,— Guy w— v, weakly in X*. 

The graph of L is closed in X X X* since L is a closed linear operator. 
Being a closed linear subset of X X X*, the graph of L is weakly closed. 
Hence the ordered pair w,w—v lies in the graph of L, i.e. t€ D(L). 

Since C is compact, Cu,— Cu, strongly in X*. For each value of k 
and each v in D(T) 
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Re(Lu,—Tv,u,—v) Z —Re(Cu, — Cv, up — v). 


Since Tu, — Tv converges strongly to w— Tu while 4, —v converges weakly 
to ty — v, ’ 
Re(Tu,— Tv, u — v) > Re(w— Tu, u —). 
Similarly 

Re (Cu, — Cv, u,— v) > Re (Cuo — Ov, up — v). 


Hence if T, =T +0, 
Re (w + Cu — Ty», to — v) Z 0 


for all ve D(T) —D(T,). Since T, is obviously hemi-continuous since T 
is hemi-continuous and since w€ D(L) == D (T), it follows from Lemma 
(2.1) that 

w -+ Cty = Typ = Tuo + Cto 


i.e. w = Tu, Q.E.D. 


Limma 2.3. Let P be a projection of X onto a finite dimensional sub- 
space F with FC D(T), P* the adjoint projection of X*, E =the range 
of P*. Then if T is continuous from finite dimensional subspaces of X to 
the weak topology of X* and if 


Re(Tuv) 2 c(lul)iwl 
for all u in D(T) where c(r)> +» as r> +, then the mapping P*T 
maps F onto F. 
Proof of Lemma 2.3. Lemma 2.3 is identical with Lemma 4 of [6]. 


Lemma 2.4. Let W be a dense linear subset of X and consider the 
family {Py} of all projections of X onto finite dimensional subspaces con- 
tained in W. Let F = U R(P,*). Then F is dense in X*. 


Proof of Lemma (2. 4). If F is not dense in X*, then by the nei 
of X.there exists u, in X, uo >40, which annihilates F, i.e. 


(4.2) (Py*v, uo) = 0 
for all v in X* and all y. Equation (4.2) is equivalent to (v, Puo) = 0, ie. 
Pla = 0 for all y. 


. Since W is dense in X, for each «> 0 there exists u, in W such that 
| to — tn | <e. a a BIT 


Banach theorem we may choose v in X* with || v |== ——and (v, u) —1. 


[a l 
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Let P be the projection of X onto the one-dimensional space spanned by th 
given by 
Pu = (0,0) th 
for uce X. Then 
| Puo | = | t + (8; to — tt) tr | 
= jua | — ie l f to — ta li iu | — i ia i e 
Choosing e < || t |/2, we have 
lul 


[a |] | to | — | ta — 40 fl E | to | 5 >e 


For such e, || Puy >0 and Pu,=40 contradicting the fact that all finite 
dimensional projections annihilate vo Q.E.D. 


Proof of Theorem 2. By Lemma 2.2, R(T) is closed in X*. Let W, 
be a dense subset of X, and let F = |) R(P„*) where Py ranges over the pro- 
jections of X on finite dimensional subspaces of W,. By Lemma 2.4, each 
such W is dense. Hence it suffices to show that for some suitable Wi, 
EPC R(T). l 

We may choose a denumerable subset W, of D(L) N D(L*) such that 
L is the closure of L restricted to W, and L* is the closure of L* restricted 
to W. Let F == |] R(P,*) where Py ranges over the projections of X on 

3 


finite dimensional subspaces of W;. Letwe F”. Then there exists a projection 
which we shall call P, of X on a finite-dimensional subspace F, of W, such 
that P,*w-w. We construct an increasing family of finite-dimensional sub- 
spaces F} of W, starting with F, such that 


We Ep 


By Lemma 3 of [7], we may find a sequence of projections P; of X on F} 
such that 


PyPy—PePy Py j<k. 


Moreover, if {P;*} is the sequence of adjoint projections of X*, and if 
Pj R(P;*), then F; C Fi and in particular we F’, C F”; for every j= 1. 

Since W, C D(L) =—D(T), the mapping P,*T maps each F; into F”; 
and indeed onto F”; by Lemma 2.3. Hence we may choose w€ F; such that 


PFT u; — 10. 


For such u,, we know that 
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 Re(w,1,) —Re(P/*Tu,1) = Re (Tup uj) = c(|w |) [ey 1. 
and hence , 


(iu) SI |. 


Since c(r) >w as r—> œ, we know that || u, | S M for all j and some constant 
M. Hence || Gu; | S M, for all j. Passing to a subsequence if necessary, we 
may assume that u;—>u, weakly in X, Gu;—> v, weakly in X*. 

Let v be any element of W,. Then v lies in F, for some r, so that 
Pp=v for j2r. 

For jr 

(w,v) a (PAT uy, v) (Tu; v) + (In, v) + (Guy, v). 
Since ve W, C D(L*), 
(Zu; v) = (uy, L*v) > (tho, L*v). 
Since Gu,—v, weakly in X*, 
(Gup v) > (vo tt). 
Thus 
(w, v) = (to, L*v) + (vo, v) 


(uo, L*v) = (w— vo v) 


for all ve Wi. However, both sides of the last equation are continuous in 
the graph of L* and the graph of L* restricted to W, is dense in the graph 
of L* by hypothesis. Hence 


(to, L*v) = (w— va v) 
for all ve D(L*), i.e. w€ D(L) and ny == w— ry. 
Finally, let ve W,. Then vE F, for some r. For jzr, 
(Tus, uy—v) = (Tu, Pj (uy—v)) = (PF Tuy, uy — v) 
= (W,Uy— v) > (W,Uy— r) 
as j—- too. For all j, we know that 


— Re (Cu; — Cov, u;—v) S Re( Tu, — Tv, uy— v) 
= Re(Tuj, uj —v) —Re(Tv, uj —v) 
where 
Re(Cu;— Cv, u;— v) > Re (Cup — Cv, to — v) 
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since u, weakly in X, and Cus— (u, strongly in X* by the Da 
continuity of C. In addition 
Re (Tu, —v) — Re(Tv, u;—v) > Bete a) — Re(Tv, u— v). 
Hence for ve Wi 
— Re (Cu, — Cv, to — v) SS Re(w— Tv, uy — v). 
Setting T,—7'-+-C, this last inequality may be written as 


Re(w +0w— Tw, uy — v) 20 
for all v in Wj. 

Let v be any element of D(T,)—D(L). Then there exists a sequence 
{vx} from W, such that v,—v strongly in X, Lv,— Lv strongly in X*. 
Since @ is demi-continuous, Gwy —> Gv weakly in X*. Since C is compact, 
and hence continuous, Cu,—> Cv strongly in X*. Hence Tr > Tw weakly 
in X*, For each k, we have 


Re(w + Ouo — Tv, Uy — x) Z 0. 


Since t—v,—>t—v strongly in X, Ryde iz a 
weakly in X*, we have in the limit 


Re(w +- Cu — Ty, uto —v) 20 


for all v in D(T,). Applying Lemma (2.1) once more, we see that Tito 
==w-+ Cu, ie. Tug =w. Hence 


F C R(T). Q. E. D. 


Section 3. We now pass to the proof of Theorem 1. As a technical 
device in this proof we may define a global boundary value problem on, the 
infinite cylinder Q X Æ as follows: 

Let Le{(R*, V) be the Banach space formed by the p-th-power summable 
functions from R’ to V with norm 


lt f TUO Ins). 
F* = {u | uc L*°(R’,V), u is continuous from R! to V, u is Ct from 


R to L@(Q), u has compact support in Rt}. 
For each u in F*, consider the sesqui-linear form 


kuo) — (TOt 
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defined for all veLr(R*,V). Then k(u,v) is a bounded conjugate-linear 
functional of v for fixed u. Hence we may define: 


` Definition. For each u in F* Lou is the element of (Le(R!,V))* such 
that 


(8.2) u = f LEU), v4) 
for all v in L? (R:, V). | 


By an integration by parts, we see that — Lo G Lo*. Hence Ly is clos- 
able as an operator from ZP(R},V) to (Ze(R*,Y))*. 


Definition 3.1. L is the closure of L, as an operator with domain in 
I*(8,V) and range in (Lr(8,V))*. 


Global variational boundary value problem: Let f € (Lr(R:,V))*. Then 
u€ Le(Rt,V) is said to be a solution of the global variational boundary value 
problem for the equation 


| u LAU 

on QX Æ if ue D(L) and 

(8.8) (Lu, v) + h(u,v) = (f v) 

for all v in Lr(R!,V), where 

(3. 4) h (u,v) = x “Ds, <Aa(a,t,u,* + +, Du), D8v(t)> dt. 


Lemma 3.1. [*¥ =—JD. 


Proof of Lemma 3.1. We know that —LCL# since —L,C L* and 
L* is a closed operator. To show the reverse, suppose u € D(L*), L*u == t4. 
Then for all v in D(L,) 
(u, Lov) = (u1 v) 
ie. 


+00 d +o 
(8.5) Nu Or = f uE) at 
Let je Co" (Rt) with f eds L,änd set 
je(8) —e7(8/e), e>0 


Ja) = fjelt—s)u(s) ds 
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Using (3.5), we find using Fubini’s theorem that 


+00 d +% 
(8.6) 1 <a) GO) dt— E (t),9(4)> at 
i.e. 

(Jt, Lov) == (Jein v). 
Hence L*J a= Jaha. Since Ju>uin Le(R!, Y), Jant in P(ER, TY), 
it suffices to show that Jeue D(L). The latter fact follows if we choose & 
in 0,” (R+) with $(s) =1 for |s| 5&1, set pe(s) (es), and let 

ul) = $e(s)Jeu(s). 


ade) 


Then as e>0, %—>Jeu in L*(R, 1), a in L2(R,V). Since 


ve€ D(L,) for each e> 0, and Ju = — u) by an obvious integration 


by parts, it follows that Jeue D(L) and the proof of Lemma (3.2) is 
complete. 


Lemma 3.2. If we D(L) with u(s) =0 for s<t, and if 9 is the 
interval [to t1], 8 the corresponding operator defined in Section 1, then the 
restriction u, of u to 8 lies in D(8) and d(u,) =v, where v, is the restriction 
of v = Lu to 9. 


Proof of Lemma 3.2. Let w be a continuously differentiable function 
from Rt to V such that w(s) ==0 for s = t, and w(s) = for 3 & to — ô for 
some ô> 0. Then w lies in D(L,) and hence 


(u, Low) = — (Lu, w). 
i. e. 


+% dw +% i 
(3.7) Ju, FOr dt—— fol), w(e)> ae 
Since u(t) =0 for t< to while a (t) ==0 for t>t,, the integral on the 
left equals 
ý dw t dw 
Se g O= f, u) O> dt. 
Since u(t) =0 for t< to and y the distribution sense, v(t) — 0 


dt 
for £< to Hence the integral on the right side of equation (3.7) equals 
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t je ti : i 
— f ow dtm f kuol), wC dt. 
Hence ; ; 
ir dw h 
Su), Gd dem J, oly dt 
In terms of the operator $, of Section 1, we have 


(to, 8,0) = (vo, w) 


for all w in D(8,). Hence u, lies in D(8,*) and &#us—= vo. It follows from 
essentially the same argument as used in the proof of Lemma (3.1), how- 
ever, that §,*==5. Hence u€ D(8) and d=. Q. B.D. 


Lemma 3.3. Suppose we D(L). Then after a change on a set of 
measure zero on R!, u is a continuous function from Rt to L?(Q). For every 
sin Ri, u(s) then satisfies the equation 


(3.8) || (a) [2x0 —2Re(Lu, Tu) 


where Tum %, u and - is the characteristic function of the interval 
(—»,8). 


Proof of Lemma (3.3). For we D(L,), we have 


(3.9) — u(s) Iam —2Re Ss <= (t),u(t)> dtm 2 Ro (Low, Ty) 
S2 | Lou Ix | Tu lz 
where X = LP (Rt, V). Since Z is the closure of L, as a mapping from X 
to X*, for each u in D(L) there exists a sequence {ur} from D(L,) such 
that us—> u in X while Lous > Lu in X*. For each k and r, we have 
| ux (8) — ur (8) 7ra S 2 | Lo (tx — tr) Ir | Ta (ur — ur) Ijz 
<2 I Lot — Loty [ze ] Ur Uy jx 0 
as k, r—>œ. Hence u,z(s) converges in L*(Q) uniformly in s on R* to 
a uniformly continuous function from R! to 12(0). Since, n>u in 
L?(R*, V), it follows that u is uniformly continuous from R! to F(Q). 
Moreover, equation (8.3) follows from equation (3.9) by continuity since 
| wes) | > || u(s) io, and (Lotz, Trur) > (Lu, Tu) as k>o. Q.E.D. 
Lemma 3.4. If Fe (L9(B+,V))*—L0(B, V*) with f(t) —=0 a.e. for 
t< t, and if u ts a solution of the global boundary problem for at Altyu= | 
with respect to V, then u(t) =0 for t< to. 
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Proof of Lemma 3.4. By Lemma (3.3), for t< to 
| w(t) lza = 2 Re (Lu, Tiu) 


where Tu m= %; u. If u is a solution of the global boundary problem, then 
for every v in L# (Rt, V), we have 


(Zu, v) +h(u,v) = (hr). 
Letv—=Tyu. Then 


(fv) = (f, Tu) =0 


since f(s) =0 for s < t and t is less than tọ. Furthermore 
h (u, Tu) = f als;ul), Bı(s)u(8))ds 


— f a(s, (eu) (8), (Bu) (8))as 


= h (Tu, Tiu). 
Hence Reh (Tu, Tu) = 0. 


Finally 
Re(Lu, Tu) = — Re{h(u, Tu) + (f, Tru} S0. 
Thus || u(t) ||? <0, which implies that u(t) =0. Q.E.D. 


Proposition 3.1. Let fo€(LZ°(8,V))* and let fe(Le(R,V))* be 
obtained by setting f—f, on 8, f=0 outside 8. If u is a solution of the 


global problem for a A(t)u—-f with respect to V, then the restriction u, 


of u to S is a solution of the variational boundary value problem for 


du 
gi tA(umfo 
with respect to V on OX 8. 
If global solutions extsts for all f, then solutions u, will exist for all fo. 


Proof of Proposition 3.1. This follows directly from the preceding 
lemmas. . 


It follows from Assumption (I) on A(Z) 
(3.10) [| h(u,v)|Selol{lel +137°* 


for all u v in L(K, V). Thus for fixed u in L? (R, V), h(u,v) is a bounded 
conjugate-linear functional of v in L°(R1,V). 
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Definition 3.2. For each u in Le (R, V) Gu is the unique element of 
(Ir(R*,V))* such that 
. (Gu, v) =A(u,v) 
for all v in Le (R*+, V). l 

From (3.10), we see that 

| Gu || SClu] +17. 
so that G carries bounded sets of LP(R*, V) into bounded sets of (Le (Rt, V))*. 

Lemma 8.5. u is a solution of the global boundary value problem with 

a homogeneous term f if and only if ue D(L) and 
(L+ G)u~=f. 


Proof of Lemma 3.5. This is simply a translation of the definition of 
the global boundary value problem using the definition of L and G. 
Lemma 8.6. There is at most one solution u of the variational boundary 


value problem on the interval 8 for the equation +4A(t)u=f with respect 
tå V for a given f in (L°(8,V))*. 

Proof of Lemma (8.6). As in the proof of Lemma (3.4), we may 
show that every u in D(8) may be chosen continuous and for every fp StS t, 
(3.11) i | u(t) [2x2 = 2 Re (8u, Tu) 


where Tyu — Bi u and 9%, is the characteristic function of the interval [to, t]. 
Let u and v be two solutions of the variational boundary problem for a given f. 
Then we have for all w in L?(8,V) 


(èu, w) + h(u, w) = (f, w) 
(&v, w) + h(, w) ax (f w) 
Subtracting, we have 


. (f(u — v), w) =— {h (u, w) —h (v, w) }. 
Applying equation (3.11) with u replaced by (u—v), we have 
|| u(t) — v (t) Pr =— 2 Re(3(u—v), Ti(u—v)) 
= — 2 Re{h (u, T;(u—v)) =h (v, T,(u—v))}. 
However, h (u, Ti(u—v)) == h (Tu, Ti(u— Tw) while 
h(v, T,(u—v)) =h(Tw, Tu — Tw). 
Hence, 
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| u(t) Pr 
= — 2 Re{h (Tu, Tu — Tv) —h(Tw, Tu—Tw)} S0 


so that || u(t)—v(t)lz==0 for ist, and finally u=v. Q.E.D. 


Leama 3.7. G is demi-continuous, i.e. it is continuous from the strong 
topology of I# (R, V) to the weak topology of (L°(R*,V))*. 


Proof of Lemma 3.. We have already observed that @ maps bounded 
sets of L? (R*, V) into bounded sets of (LP(R',V))*. Let {ux} be a sequence 
from L» (R, V). If {Gu,} does not converge weakly to Gu in (L°(R*,V))*, 
there exists an infinite subsequence which we may again designate as {Gur} 
and an element v of L°(R',V) such that (Gu,,v) converges to a limit 
different from (Gu,v). Hence it suffices to show that this last subsequence 
(Gurs, v) has an infinite subsequence converging to (Gu, v). 

Since u,— u strongly in L?(8,V), we know that for k— œ 


f i fi Deu; — Deu |? dedt > 0. 


We therefore choose an infinite subsequence, which we again denote by {us}, 
such that Deu, > Deu a.e. on Q X Rt. 


Let 
(3.12) km Z | Du |P= + g(7, t), 
= 
3.13 h == = Du m x,t), 
(3.18) sa + g(a, t) 
(8.14) Jen helm tts: © +, DMa), 
% 
(8.15) gummi -Aa (z, t, t ++, Day). 


We may obviously assume without loss of generality that g(z,t) > 0 for 
all (x,t) in QX Æ. Thus all the above are well-defined and we know from 
Assumption (I) and the a.e. convergence of Dus to Du for | 8 |= m, that 


| ga,x | SM for all k and « with jal Em, 
Baz Ja a.e. for |a| Sm. 


Moreover for all k, hy and h lie in Ze(QX R), g=p(p— 1)". Further- 


more 


S, Í | (hr— R) (a, t) |1 dedi > 0 


as k-o. 
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Thus 


(Gu, 0) —G(u,v) => f Alain, De) 
—Aa(z,t,u,- > +, Du), D*vy dt 


S f <gaxhn, Devy dt — f <gak, D*v) dt} 


However 


SJ Sean, Diy dt— È h(a, t) (gaxe(2 #) D*0 (a, t)}* ded 
-9 Q 


where hy—>A strongly in Le(QX Rt) while ga,D% converges strongly to 
gaD"v strongly in Zr(QX Rt) by dominated convergence. Hence 


- So Dw» di— S gah, D> di 
and (Gus v) > G(u,v). Q.E.D. 


Proof of Theorem 1. We know from Lemma 3.6 that there can be at 
most one solution of our given boundary value problem. We only need to 
establish the existence of at least one solution u. By Proposition (3.1), we 
need only show that the global boundary problem has a solution for every f 
in (Lr(R!,V))*. By Lemma 3.5, this will be true if and only if for 
the operators L and G defined previously in this Section, T == L + G maps 
Le (Rt, V) onto (Lr(R},V))*. 

By Lemma 3. 7, G is demi-continuous and maps bounded sets of L? (Rt, V) 
onto bounded sets of (£°(R*,V))*. Lisa closed linear operator with dense 
domain in L*(#1,V). By Lemma 3.1, L* ==— L so that D(L) N D(L*) 
== D(£) and the condition that Z is the closure of its restriction to 
D(L)ND(L*) is satisfied vacuously. Finally, 


Re(Tu— Tv, u—v) = Re(L(u—v), u—v) + Re(Gu— Gv,u—v) 
where 
Re(L(u—v),u—v) =— Re(u—v, L(u—v)) =—Re(L(u—v),u—v) 
so that 

Re(L(u—v),u—v) =0, 

while 

Re{ (Gu, u— v) — (Gu, u—v)} = Re{h (u, u—v) —h(v,u—v)} 20 
for all u,v € IL? (R*t, V). Hence 
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: Re(Tu—Tv,u—v) 20 
for all u, ve D(T). 
Similarly for ve D(T) 
Re(Tu, vy = Re(Gu,v) —Reh(u,v) =c(f[uf)iul 


so that all the hypotheses of Theorem 2 are satisfied for T. Hence T is onto. 
Q. E. D. 
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COMPACTIFIGATIONS OF SYMMETRIC SPACES II: 
THE CARTAN DOMAINS.* 


By Carvin C. Moors. 


Section 1. If G is a semi-simple Lie group with finite center and K 
a maximal compact subgroup, the space G/K is a symmetric Riemannian 
space of non-compact type. In a previous paper [13], we have investigated 
certain compactifications of G/K which are obtained by embedding G/K 
into a space of probability measures on a boundary of G, We have shown 
that these compactifications, introduced by Furstenberg [2], are the same as 
Satake’s compactifications [15]. Satake remarks (p. 104) that if G/K is a 
classical Cartan domain [1], then one can verify case by case that one of these 
compactifications is homeomorphic to the closure of the Cartan domain when 
it is viewed as a bounded domain in complex Euclidean space. One of our 
main results will be to give an intrinsic proof of this theorem. In the course 
of the proof we will be able to construct the desired homeomorphism in a very 
natural way using the properties of Furstenberg’s compactifications. 


Section 2 is devoted to the proof of an algebraic result concerning the 
roots of a Cartan domain which is needed later. This theorem has been con- 
jectured by Bott and Koranyi. Although one could verify this result also by 
checking it case by case, it seems to be of interest to have an intrinsic proof. 
In Section 3 we prove the theorem mentioned above. Lemma 3.1 on the 
structure of the Shilov boundary of the domain has been proved by Koranyi 
and Wolf [11]. In Section 4 we shall discuss the boundary components of a 
Cartan domain as defined by Pyatetskii-Shapiro [14]. We will give intrinsic 
proof of his main theorems and some additional information which we can 
obtain from our point of view. 


Section 2. Let @ be the connected component of the group of analytic 
automorphisms of an irreducible bounded symmetric domain D. Then 
D = G/K where K is a maximal compact subgroup of G. For the following 
see for instance, [4], [5]. It is known that K has one dimensional center 
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and has the same rank as G. Let go and f, be the Lie algebras of G and K 
and let po be the orthogonal complement of f, in go; further let a, be a 
Cartan subalgebra of fo Let g, f, p and a be their complexifications and 
u—=f)+ ip. a compact form of g. Now a is a Cartan subalgebra of g 
and the roots of g fall into two exhaustive classes, C=={a: XzEf} and 
P= {a:Xa€ p}, the compact and non-compact roots respectively where Xa 
are root vectors. The adjoint representation of f on p decomposes p into two 
irreducible subspaces p*, and p* is spanned by {Xa: «€ P*} where P* denote 
the positive (negative) roots in P in an appropriate oredering. If u,‘ - *, Ha 
are the fundamental roots of g (with respect to an ordering fixed once and 
for all) we may assume that p, is the unique non-compact fundamental root. 
The compact roots are those of the form X nyu (+= 2). 


Lemma 2.1. If BEP, then B= pm t+ Engu (22). 


Proof. Since Xp is in p* and ad(f) is irreducible on p*, every Xg can 
be written as c-[Xa, [Xay* * <; [Xan Xm]]: °°] where c is a constant and 
a," are compact roots. It follows that B—=pit Ding, (422) as 
desired. 


Harish-Chandra [4] has constructed a family of strongly orthogonal 
roots yuy’ ' ",ym Which play a fundamental role in our discussion. (Two 
roots, a and 8, are strongly orthogonal when a= £ are not roots.) The root 
yı is the lowest root in P*; that is m, and yr is inductively the smallest root 
of P* strongly orthogonal to yı’ * -,yra. Let V be the subspace of a spanned 
by the y’s and a the orthogonal projection of a onto V. Harish-Chandra has 
proved the following facts. , 


Lemma 2.2. If B ts a positive compact root then there are ihres posst- 
buities: 


1.) (8) =0 in which case 8 is strongly orthogonal to all yı 

2.) m(B)=— $y in which case B is strongly orthogonal to all yr, k At. 

3.) ~(B) =}4(y;—y), 7 >i in which case B is strongly orthogonal to 
all yx, ke 5&4, j. i 


Moreover B + y; is not a root. 


We shall examine which of these combinations occur; the end results are 
Theorem 1 and 2. We first need some t facts (D will denote the 
set of compact fundamental roots.). 
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Lemma 2.3. If Bı and 8,€ D, then we can find @,a,:--+,% in D 


3 
such that x(a) = (ßı) and (a) =r (B2) and such that Ya; is a root for 
4=0 
j=0,1,°°-,0 


Proof. The roots of D form a Dynkin diagram, and if this diagram is 
connected our assertion is clear. (We may take A, = &, and B: =a.) If 
D is not connected then the non-compact fundamental root occurs in the 
“interior” of the chain of the Dynkin diagram of g. Using Lemma 2.1 one 
can see that g == A, and we can check the lemma very simply in this case. 


Lemma 2.4. For each t==1,2,:--,m, we can find a€ D such that 


("(a),y) = (a, yi) 40. 


Proof. If (y,@) —=0 for all «€ D, and if !>1, (ypyı)==0. Now 
DU {yı} is a fundamental system of roots and hence a basis in the Cartan 
subalgebra a, and yı is orthogonal to each one of these vectors. This is of 
course impossible. If Z= 1, then we can find «€ D so that (y1,«) <0 since 
the Dynkin diagram of g is connected. 


We first examine those compact roots « for which x(a) = — fyi- 


Lemma 2.5. If BED and r(B) =—4y, then imm (yn is the highest 
strongly orthogonal root). 


Proof. First suppose that 6, and f. are in D, and r(81) =—4y, 
(82) =— tye with k >i. We find a chain ao a'> +, a; by Lemma 2.3. 

We contend first that if A, and A, are compact positive roots so that 
Aı + Az is a root, and if m (à) = — Fy, then # (A) = $(yi— y) or 0 for ij <t 
and r(A1 + Az) =—4y;, for j&i. Suppose first that (As) ——4yx, then 
m(Ar + Az) == — fyi — $y: a contradiction to Lemma 2.2. Then if r(Az) 0, 
(As) = 4$(yi—y;) for 7 <l. Since A, + A. is a root it follows from Lemma 
2.2 that l == t, and we are done. 

Since r(%) = — $y, we can argue inductively using the result of the 


previous paragraph to show that +( $, u) =—4y, with ji and that »(a,) 
4=0 


=0 or (u) =—4(ys—y), J<sSi, for all n—el,2,---,1 But for 
n=l we find a contradiction since +(a:)==—-4y,. Therefore among the 
(a), «€ D at most one — dy; occurs. 

Suppose now 81€ D and (A) = —4y with t<cm. If aED, then 
(a) #— fym by the first part of the proof, but there exists @,€ D so that 
(Be, Ym) #0 by Lemma 2.4. It follows that +(82) = $(ym— Yn) for some 
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n<m. Now we choose %, @,° * `, & according to Lemma 2.3. By the same 
argument we used in the first part of the proof for k==1,2,-- -,1, (ar) =0 
or 1(ay) == $ (ys — y) with j < st, and in particular s <m. If we take 
k=l, #(a) =4(ym—yn) and we have a contradiction. Thus our Lemma is 
established. 


Lemma 2.6. For anyl < m, there is an a€ D such thul na{a) = 4(yz— yi) 
(>i). 


Proof. If this were false for some <m, then for all «€D, 
x(a) =4(y;— ys) with 741 or x(a) =—#ym. But by Lemma 2.3 y+ a 
is never a root. Moreover y; + y, is not a root, and since D U {yı} is a funda- 
mental system of roots yı+ 8 is not a root for any fundamental root 8. In 
this case yı must be the highest root of g, and since yr <y„, this is impossible. 
The lemma is therefore proved. 


LEMMA 2.7. If B, and p, are in D, it is impossible that m(Bı) = ya — Yı) 
and x(B:) =$(y—y;) with i<j <k. 


Proof. If this were the case, we may choose a,‘ ‘ +, a; by Lemma 2.3. 
We first suppose that for no r do we have m(a,) = —#ym. Then we claim 


that for n=0,1,-- +, (So) $ (ye— ys) with 22% and si. This 
r=0 


is true for n == 0 and we proceed by induction. If it is true for n and w( a1) 
== 0, it is true for n+1. Thus we may suppose that (a) = $ (Yp — Ye)» 


n+l 
and we have A = (3) = $ (yt— ya) + $ (Yp— ya). In order not to contra- 
r=0 


dict Lemma 2.3, we must have either p = 3 or t =g. If p= s, then q < p =s 
and A= $ (y:— y) with tZk and g<sSi as desired. If i=g, then 
p>q=t and à= $ (yp— ys) with p>t2k as desired. This also proves 
that if r (€m) 40, then x (as) = $(yp— y) with either p >k or q<i 
for n=0,1,---,l-—-1. Now we take n==}— 1, and (a) = $(yr— y) 
where we must have j <4, a clear contradiction. 

If now $ (aan) =— $ym for some a, we may take a minimal. Then 


by the previous argument Sei with ss: It is clear 
r=0 


+1 
that we must have {= m and that a( Sa) == — Jy, with s+. It follows 
r=0 


by the argument given in the first part of Lemma 2.5 that for r>a-+-1, 
m(@)<=0 or a(r) =4(yp—ye) with g< pi. If we take r=] then 
(u) =$ (yx— y) with i<j <k, and this contradiction establishes the 
lemma. 
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We obtain our first main result. 


THEOREM 1. The non zero vectors in (D) are 


l Im—n),' . -, (Ym — Yo) 
together with perhaps — }ym- 


Proof. In Lemma 2.6 we choose = m-—-1, and it follows that 
4(ym— Ym-ı) is in (D). Now suppose that $(yu1—y:) is not in (D). 
We now choose a maximal such i (i <m—1). Now in Lemma 2.6 let 
l= į and we find that +(D) contains $(yE—ys) for some k>++1. By the 
maximality of i, (D) contains $(y,—yx1)where k—1 >i. Now if we let 
j==k—1, Lemma 2.7 is violated. Therefore (D) contains all vectors of 
the form I(ya—y) j=1,2,°°°,m—1. Moreover if =(D) contained 
some $(y— yi) with k>+-+1, Lemma 2.7 is violated again. By Lemmas 
2.2 and 2.5, —dym is the aus other non zero vector which could belong 
to r(D). 


We denote by R the set of all roots of g. 


THEOREM 2. 1) There are two possibilities for (R) escept for 0. 


(a) RU {0} = {+ dys $y; all i and 9} 


(b) a(R) U {0} = {+ dy + Fy, + Fy all i and j) 
2) The yı all have the same length. 


Proof. 1) We first claim that every $ (y;— y:i) j > t is contained in »(C*) 
(C* denotes the positive compact roots.) In fact we can find 8, and 8, in D 
such that m (81) = $ (ym — ys) and w (82) =$ (ys— ysm). (We are assuming 
as we may mee et) Then if we take &° + *,@, as in Lemma 2.3, it 


is easy to see that x( Sa) = $ (y; — yi). 


_ Now suppose thet —tymf¢a(D); then we claim that —}y,¢7(C*). 
If D = {uz + +; un}, and a € Ct, a= Si nyu. We shall show that x(a) 4— +4 
by induction on l(a) Sin, This is true by Theorem 1 if I(a)—=1. If 
Ka) —1-+1 there is some i such that au is a root. Now #(@— pm) 
= $ (ys— yı), and since (u) =$(yrı—y,) or 0, it is clear that x(a) 
Ady for any j: 

Combining these results with those in [5], p. 587, we see that if 
—#/m£r(D) then we have the first alternative for 7(R). 
Now suppose that —}ym€a(D). In order to prove that «(R) is given 
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by the second alternative, all we need show is that —}y,¢€2(C*) for any i. 
But if we take according to Lemma 2.3 a%,- ` -, a, such that m (ao) = — #ym 


t 

and (a) = $ (ymı— yı) it is clear that (da) =—4y. The first part 
a= 

of the theorem is now proved. 


2) Ifi< j, then we can find g€ C+ such that m (a) =4(yj;— yı). Since 
(a y) =— $ (yoyi) <0, y+ a is a root. Suppose that as&r(«). Then 
we claim that À == y; 4- 2a is not a root. If it were, it would be positive and 
non-compact with (8) =y; Then (8, yj) = (Ys y) > 0, so that à= 8 — y; 
is a root. But now A is compact and non-zero since «>£r(a). On the other 
hand (A) =0, and by Lemma 2.2, A is strongly orthogonal to y} Since 
ß=A-+y is a root, we have a contradiction so that y+ 2a is not a root. 
But now „— a is not a root since (y,«) <0 and the « chain through y; has 
length at most 4 ([9], p. 117). It follows that 2 (yn a)/ (a, a) =— 1. 

We know that y,;-+ a is not a root (Lemma 2.2), and since (y„a) > 0, 
yj--@ is a root. By the same argument as above, it follows that y;— 2a is 
not a root, and we can conclude that 2(y„a)/(a,a) =1. Combining these 
results we see that (ypa) =:— (ypa) or that 4(y), y) =$ (ypy) as desired. 

Now let us suppose that a =r (a) = § (yy— y). Then y+ 20 == yj is a 
root, whereas r(yı— a) = yı — $y; and r(y 4 3a) = gy — r so that 
y-—a and yi + 3a are not roots. Thus 2 (a, y,)/ (a, a) ==—2. By the same 
argument, 2? (a, yz)/ (2, a) =2 and we find as -before that (ypy) = (yo yi). 

Remark. Koranyi and Wolf, [11] have shown that alternative 1 is a 
necessary and sufficient condition that @/K be realizable as a tube domain 
over a domain of positivity. 


Section 3. We shall now apply these results to study the Cartan domains 
G/K. We observe (cf. [5], p. 219) that the root vectors X«, a€ R may be 
normalized so that r (Xa) == — X_a where r is the involution of g leaving u 
fixed. Also we choose these so that [[Xe, Xo], Xa] = 2X. and so that Nap 
is real and satisfies Nag——-N_a-s where [Xa, Xg] —=NoagXasg if a+B is 
a root. We denote by A, the vectors (Xy, + X_,,)/2 where the Xa are fixed 
once and for all. Harish-Chandra’s fundamental result is the following 
([5], p. 314) 


THEOREM. The vectors Ar,‘ ' `, Àm span a maximal abelian subspace 
of Do. 

Now we write a == ao* + ao” where ia, is the (real) subspace spanned 
by ya and aot is the orthogonal complement. Further let c be the Cayley 
transform of g defined by 
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c— ad (exp (1/4) 3 Fe): 


This is essentially the Cayley transform in [11]. Then c is the identity 
transformation on as* and e([Xy, Zn ]) = 2. Since [Xyp Xy] = 2%/dy 
-where d is the common value of (yi, yi), c(i) is a maximal abelian subspace 
of po. Then c(a + iao) == aot + §- — ho is a Cartan subalgebra of go such 
that Bo= (Bo N fo) + (BoM po) and HoM po is maximal abelian in po IH 
is the complexification of o, c(a) =} so that set of roots % of g with respect 
to § is c(R) where R is the set of roots of g with respect to a. We can 
rephrase the result of Section 2 in this terminology. (We use = again to 
denote the projection from bo to H~. 


THEOREM 2’, The set of projections of X into Y has one of the two 
forms 


1.) w(%) U {0} = {d(+ $u + gay) all i and 7} 
2.) #(2) U {0} = {4(+ 4u + 44), d(+ þu) -> all i and 7}. 


We totally order the real vector space b- by the relation z > 0 if z = $ apu 
and the last non-zero a, is positive. We totally order ia,* and define a total 
ordering on HH tao by (h, ht) > 0 if h- > 0 or if h= 0, then ht> 0. Let 
@,' ` *,%, be a fundamental system of roots of g with respect to § in this 
ordering. Then we let F be the set of distinct non-zero restrictions to 5 of 
the (a) (F is called a restricted fundamental system of go, [15]). Finally 
let W be the restricted Weyl group of g, and A be the open positive Weyl 
Chamber in §-. 


THEoREM 3. 1) F has one of the two forms 

a) dAı, (d/2) (As —A1)5° 5 (4/2) (Am — Àm) 

b) (d/2)d1, (4/2) (As —à1)s* > +5 (8/2) (Am — Amt). 

2) W consists of all transformations of the form M—> + àsa where o 
is a arbitrary permutation of 1, --,m. 

3) A= {H= any: 0< h <a L: <m}. 


Proof. We note that the set of non-zero restrictions to }- of the positive 
roots of g with respect to 5 are (4/2) (y—yı), 7 >4, (d/R)(y-+-y) and 
d/2 y; if the latter occur at all. The set F may be characterized as the smallest 
subset of these such that each one can be written as an non-negative integral 
linear combination of vectors in F ([15], p. 81). If no d/2 y: occurs, this 
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set is clearly given by (a) and if these do occur it is clearly given by (b). 
This proves the first statement. 

It is known ([15], p. 81) that the set F forms a Dynkin diagram and 
that W and A are respectively the Weyl group and open positive chamber of 
this diagram. We observe that in (a) F is the diagram of Cm and in (b) F 
is the diagram of Bm. In both cases the Weyl group and positive chamber 
are given by (2) and (8) respectively. 

According to [4] @/K may be embedded holomorphically as a bounded 
domain in the complex vector space p. The adjoint representation of To 
on p~ is equivalent to the adjoint representation of f, in po. Thus since p 
is irreducible, p, can be uniquely given the structure of a complex vector 
space so that these representations are equivalent as complex representations. 
On can check, using the normalization of the Xa that Xg (Xg-+ X-g) /2 
and iX_g->1(X_g—X,)/2 for BE P* is a k,-invariant map over R. It will 
be simpler to use p, with this complex structure in place of pr. Using [4], 
we see that G/K may be embedded as a bounded domain and the mapping 
which we denote by 2 is given by 


2(k-exp( Sans) K) =ad(k) (Z tanh (a/2)A.) 


where Sach and KEK. Let D =—z(G/K) and D the closure of D. 
Then it can be seen that the action of @ extends continuously to D so that 
D is a compactification of D. We shall now show that it is one of the 
Satake-Furstenberg compactifications. 

These compactifications are in one-to-one correspondence with faithful 
([13], $4) subsets of F (F is the restricted fundamental system of go.) 
Since go is simple, all subsets except F itself are faithful. If # C F, then 
we recall from [13] that ¢3(G/K) is the corresponding compactification 
of G/K. 


Tarorem 4. If E= {d/2(A2—Ax),* ` `o A/Z Am — Am-ı)} then oa(G/E) 
is homeomorphic as G-space to D. The subset of point masses, G/B(E) in 
$n(@/K) is homeomorphic to the Bergmann-Shilov boundary of D. 

The first step in the proof will be to identify the Bergmann-Shilov 
boundary of D. Let M, = (G/K) be the maximal compactification defined 
by Furstenberg; the corresponding subset of F is the void set. Then Fursten- 
berg [2], p. 370 shows that one can map M, equivariantly onto D. We 
briefly recall this construction. If z is any coordinate function on Po, zi is 
analytic and since D is Kahler, 2, is a harmonic function which is continuous 
on ®. By Furstenberg’s boundary value theorem z; has a boundary value fr 
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which in this case is a continuous function on G/B. Now G/B C Me, as the 
set of point masses and f; can be extended continuously to all of M, by 


Fa) — SA) du(b) 


for „€ M, (of course if p= (s), SE G/K, then (a) = %(2(8)) where 2 
is the embedding of G/K into po.) Now he defines a map f of M, into pa by 


f(e) = (file): > fa(a)) 


where 2,,° * `,Z„ are complex coordinates on po. This is clearly independent 
of the coordinates, continuous and equivariant, and maps M, onto D. He also 
shows that f(@/B) is the Shilov boundary 8 of D. Thus it is clear that f 
sets up a homeomorphism of @/C with S where C is some subgroup con- 
taining = 


Tank 3.1. If Bis asin » the statement of Theorem 4, then S = G/B(E). 


Proof. We first claim that f(B) —Ss—«€ D, where f is the equi- 
{1 


variant map of G/B onto 8. Let H be a regular element of A C h-; that 
is H =$ amu with 0< <<: '<am If b;=exp(tH), we know 
from [18] that $(b:K) tends to a point mass at B in G/B. Therefore 


f(B) —limz(b;E) where the limit is taken in . But clearly making use 


of the formale for z above, we see that f(B) —e as desired. 

Now as remarked above S=@/C where CD B and by the previous 
paragraph C is the subgroup of G which leaves «€ D fixed. We know that 
C=B(D) for some DC F, and by the above O N K must be the centralizer 
of e in K. Also COK—B(D)ANK=M(D). Therefore De{A: ACF: 
A(e) 0} and it is clear that this is precisely the set EF described in 
Theorem 4. 

We can now construct a map from M—=¢a(G/K) onto Ð: If his the 
projection mapping of G/B onto G/B(#), and p is a probability measure on’ 
G/B, h{u) is the probability measure on @/B(E) defined by h(p)(A) 
ma (A)) for a Borel subset A of G/B B(E). It is easy to see that h maps 

Mo— $(G/K) C) equivariantly onto M == ¢5(@G/K). Recall that the map f 
of M onto D defined above has the property proved in Lemma 8.1 that 
7 (8) =f (82) if 8 and 8 are point masses at b, and b, in G/B such that 
h(b:) ==A(bz). It follows from the definition of f that f(u) = f(u) if 
mE My and h(u1) A(z). Therefore we can define a u g from M onto D 





COMPACTIFIOATIONS OF SYMMETRIO SPACES II. 367 


by g(p) =f (w) when We M, and h(p) =’. It is clear that g is continuous 
and equivariant. It is easy to prove the following characterization of g. 


Lemma 3.2. If b is any harmonic function on D = G/K, continuous 
on D, then b restricted to S corresponds to the abstract boundary function 
on G/B(#) and 


DD) = f ble) du(s) 
for any pE M. 
The remainder of this section is devoted to the proof that g is one-to-one. 
For this we will need to use the detailed structure of M given in [18]. 


Lexma 3.3. If E= {4/2 (a —M) ©, d/2(Am—Àm1)} then the E- 
connected subsets (cf: [13]) are of the form 


Dy = {dà (4/2 M), d/2 (u— Ma) Le, >, he} 
for k—0,1,2,---,m, where we understand D, to be void. - 


Proof. Clearly each D, is H-connected since if #40, all elements of D, 
are connected to dA,(d/2A,). Let D be a non void Z-connected set; then if 
DCE it is clearly not H-connected. Thus dA,(d/2A.) lies in D. Let Dy be the 
largest set of this form contained in D. If DA Dz, then d/2 (Au — Ar) € D 
and D— D, is clearly a union of components of D which lie entirely in F. 
Thus, D is not E-connected by definition, and we are done. 


Lemma 3.4. 1) If ni= 1,2 belongs to da(exp(A)K) and if g(v1) = g(r), 
then vv. 


2) If vE ba(exp(A)K), then we can find a sequence H,€ A such that 
doa(exp(H,)K)—>v and such that ad(k)H,—H, for any k such that 
ad(k)g(v) =g (7). 


Proof. (1) Let ux be the K (D+) invariant measure on the orbit O(Z)?». 

` Now let HrEeA so that v= lim ¢x(exp(H*)K) exists. Then H” = X afn 
with 0<4,*Sa,"S- - -Sa„” for each n. We may suppose that A(H”) 
has a non negative limit (finite or -+-co) for each AC F. Let D be the subset 
of all A€ F such that A(H”) has a finite limit, and let D, be the maximal 
#-connected subset of D. Then it is clear that a” —> a? for i=1,2,; > +, and 


; k 

that a > -+o fort 1. If we define H° by Ya, it follows from [18], 
H 

Theorem 7 that y = exp (H°) u. Now 
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96) — lim X tanh (07/2) 4) 

— Š tanh (2/2) CH Er 
4-1 k 


Thus if we are given g (v) — >, ti, we can determine the index k by the rule 
that tx is the first coefficient equal to 1. Further the t, i & k determine H° 
completely so that g(v) will determine v„—exp(H°) -pe This proves part 
(1) of the Lemma. 


(2) Let Y=g(v) be given. Then if D = {à: A€ F,A(Y) =0}, we see 
‘that the centralizer of Y in K is M(D). Conversely the centralizer of M (D) 
in his {H: A(H) —0 for all A€ D}. It is now completely obvious that one 
can choose a suitable sequence H”. 

We shall now show that the map g is one-to-one. Suppose that p E€ M 
i— 1,2, and that g(u:) —g(ys). We know from [13] that we can find v, 
and v: in ¢y(exp(A)K) and k, and k: in K so that w—ky. I£ Yi=g(n) 
then g(m) = g (pa) means that ad (kı) Yı = ad (kı) Y: or that F, = ad (k) F, 
where k= kytk, Since Y,€ }- we know that k==s-m where m centralizes 
Y, and s is in the restricted Weyl group. Thus Y,—=ad(s)Y, and since F, 
and F, both lie in the closed positive chamber A it is easy to see that 
FY, = Y, and that k centralizes Y,. By part (1) of Lemma 3.4, vı = v} 

Furthermore v, = lim exp(H")» where u is the K invariant measure on 
9=@/B(E). In virtue of part (2) of Lemma 3.4, we may also assume 
that ad (k) H” = H”. Thus 


k- v, = lim exp (ad (k) H”) kp = v 
since k "RL. Finally 
pa = kava == kavy = hy ky they, m Ik ty, om Bey, me Ba 


so that the mapping g is on-to-one. Theorem 4 is completely proved. 
We note that Theorem 4 gives us an affirmative solution to the Dirichlet 


problem for D relation to'S cf. [6], [12]. A function f is harmonic in D 
if Af=0 where A is the G-invariant Laplace operator on 2. 


THEOREM 5. If b is any continuous function on the Shilov boundary 8 
of D, then there ts one and only one function continuous on D, harmonic 
on D and taking the given boundary values on 8. 


Proof. If we replace D by M=—¢2(G/K) and S by G/B(E) C M, the 
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existence and uniqueness of the harmonic functions is clear from Furstenberg’s 
work. Then Theorem 4 immediately implies the present theorem. 


Section 4. In this section we shall treat Pyatetskii-Shapiro’s [14]. 
theory of boundary components using the tools we have developed in the first 
three sections. We preserve our notation from the previous section. Let 
D m D; be an E-connected set, and we consider the corresponding subalgebra 
g(D) of g defined in [18]. 


As before let c = ad (exp (1/45 (F555) be the Cayley transform 
4-1 


x 
of g and let cp = ad (exp (7/4 > (Xy, —Xy)). We know that c(a) =} 
H 


and also c(y;) = dà, +—=1,---,m. If g'(D) is the derived algebra of the 
centralizer of the set of elements ya,‘ °°, ym, then it is clear from the 
definition of g(D) that c(g(D))==g(D). On the other hand 
x 

g'(D) = (g (D) Na’) FEC y+ EX, Bes 
where © is the set of roots of g with respect to a such that (8,y:) =0 
t—k-+1,---,m. But if (8,1) =0 we know that £ is strongly orthogonal 
to yı and hence ¢(Xg) —=cp(Xg) BES. Further c=cp=1 on at and 
ey) = en(y) fort—1,---,k. Thus c= cp on g(D). Finally we observe 
that +y,€ 8 and hence cp€ exp(g/(D)). Therefore g’(D) = cp(g’(D)) 
=c(g’(D))—g(D). We have proved the following facts. 


Lemma 4.1. g(D) =g (D) and g(D) is invariant under c. 


Recall that G(D), the subgroup of G corresponding to the subalgebra 
g(D) Ngo is semi-simple, and G(D) NE =—=K(D) is a maximal compact 
subgroup. l 


Lemma 4.2. G(D)/K(D) is an irreducible Hermitian symmetric space. 


Proof. We first observe that if po(D) is the orthogonal complement of 
fo(D) in go(D), then po(D) C po. Since h (D) C po(D) and 


p (D) =ad(K(D)) BD), 


it is enough to observe that h7 (D) C po. Therefore the complexification of 
po(D), p(D) lies in p. 

We know that D is a restricted fundamental system of roots of go(D), 
([15], p. 83). Since the Dynkin diagram of D is connected, it follows that 
G(D)/K(D) is an irreducible symmetric space. Further it is known that 
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it will be Hermitian symmetric if and only if the adjoint representation of 
K(D) on p(D) is not irreducible. 

But if p= pt + p is the splitting of p under ad(K), we know at once 
that p"Np(D) are invariant under K(D). But now by Lemma 4.1, 
Zayi € P= p(D) so that both of these spaces are non-trivial. Thus ad K(D) 
is not irreducible on p(D) and the lemma is proved. 

It is clear that a(D)=g(D)=g(D)Na is a Cartan subalgebra of 
t(D) and g(D). Moreover the roots of g(D) with respect to a(D) are exactly 
the roots of g which lie in a(D). The roots of g(D) can then be ordered 
compatibly with the roots of g. It is clear that any fundamental root of g 
which is a root of g(D) is a fundamental root of g(D). 


Lemma 4.3. The set {yu ya)‘ © +, yk} are the Harish-Chandra strongly 
orthogonal roots of g(D). 


Proof. By the comment above, y, is a fundamental root of g(D) and is 
non-compact since Xy, € p(D). Therefore it is the unique non-compact funda- 
mental root of g(D). Furthermore, y; is the smallest positive non-compact 
root of g(D) strongly orthogonal to ys’ -,yu, (ISk) and this suffices 
to characterize them as the strongly orthogonal roots of Harish-Chandra. 


Remark. It follows at once that the mapping cp defined in the proof 
of Lemma 4.1 is the Cayley transform of g(D). 


Let zp be the Harish-Chandra embedding of @(D)/K(D) as a bounded 
domain in po( D). We note first that it is easy to see p,(D) with the complex 
structure it inherits, is a complex subspace of p>. We can obtain a formula 


for zp by making the appropriate changes in the formula for z in Section 3. 
We obtain the following: 


k k 
ap (exp ( 2 ad) K(D)) —ad (k) ( Z tanh (a/2)u) 
for kEK(D). i 
On the other hand it follows from [13] and Section 3 that the symmetric 
space Sp==G@(D)/K(D) may be embedded in the boundary 8D of D. 
Denote this mapping by tp. Then if ke K(D), 


k 
in(kexp( Zar) K (D)) = så (k) lim 2 (exp (tHo + > ai) K) 
where Hp = Ania + Mn + + (m— k) àn is a “regular” element of v(D) 


the orthogonal complement of Y- (D) in §. The limit can be evaluated at 
once, and it is equal to 
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ok 
ad(k) (2 tanh (a,/2) 4) + ad(k)en 


m 
where ep = > à. Finally we note that en is centralized by K (D) so that 
dk 
ad(k)en =p. 
A comparison of the formula for zp and tp yields the following Lemma. 


LEMMA 4.4. For se Sp, tp(s) ep + 2p(s). 


The content of Theorem 7 of [13] is that the sets k-tp(Sp) for all E- 
connected sets D unequal to F, and all kE K, either coincide or are disjoint 
and exhaust the boundary d#(D) of D. We shall show that these sets are 
exactly the boundary components of Pyatetskii-Shapiro. 

The following lemma will play a crucial role in the sequel. This result 
was obtained by R. Hermann previously (unpublished). We denote by r the 
conjugate linear involution of g whose fixed points are u. Then if ( , ) is 
the Killing form on g, H(u,v) = — (u,7(v)) defines a positive definite 
Hermitian form on g. Furthermore if Pe po, ad(P) is an Hermitian trans- 
formation with respect to this form. We use | ad(P.)| to denote the norm 
of ad(P). 


Lemma 4.5. The domain D -== {P: PE p, and |ad(P)| <1}. 


Proof. If kEK, |ad(ad(k)-P)|—|ad(P)| since ad(k) is a unitary 
transformation. Since p=ad(K)h and D=ad(K) (FN D) it is enough 
to show that 

Db ={H: He bh | ad(HZ)| <1}. 


But if H = 4A, then in a Weyl basis of g, ad(H) is diagonal with 
eigenvalues which can be read off from Theorem 2’. To be precise the eigen- 
values are dl/2 (= i + t) together with perhaps dl/2 (= t) where l is the 
common value of (à, M), and d is the common value of (yeyi). From the 
definitions we see that c(y) = du and since c preserves the Killing form 
d= (ypy) =P (`, M`) = dl. Thus di—1 and ad(H) has eigenvalues 

1/2(+%-+ ty) together with perhaps + $t It follows that 


{H: |ad(H)| <1} ={H: H=Strylu| <4}, 
but the later set we know is just D N p~. 


Remark. It is interesting to note that the function | ad(P)| is plurisub- 
harmonic (PSH). To see this, we note that | ad(P)| u: | H([P,«],«)|, 
ei=i 
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since ad (P) is Hermitian. Now H([P,z],r) is a real linear functional on po, 
hence it is PSH. The absolute value of a PSH function is likewise PSH 
and the supremum of a family of PSH functions is PSH provided it is con- 
tinuous as | ad(P)| is. 


Lemma 4.6. 1) If c€ D then |(2,u)|S (As à) 


2) Let cen 4- yE Po where (y, u) =0 tf t> bk. 
Then if ze D, we must have y€ po(D). 


Proof. We observe that the vectors 
ag== (Xg + X_s)/2 and bg—=1/2(Xp— X) 


for 8€ P* form an orthogonal bases in py. Finally let cg— [Xp, X-4]/2 
=-1/(8,f8)B (see [5], p. 315). Then we see that 

Lag, ibe + cp] = ibg + cp, 

Lay, ibg + cp] =E + (y,8)/(B,B)iby if By, 
where K€ k and K La, 


[by iba + cg] = (y,8)/(8, B) (— tay) +’, K’ as above. 


For convenience, we let z = iby, + Cy, 7 
For part (1) of the lemma, let ze D and z= Na, + syby (yE P*). 
Then 


[z, z] = tyu + 5 Sy (y, yi) / (Yo yı) (— iay) 
tt (ys y1) / (Yo yi) iby HE 


where KE k and Kia. In the Hermitian metric on g all terms but the first 
are perpendicular to z; Thus 


H (ad (z) 2, 25) = ty H (2,2). 


Now since ad(x) is self adjoint and |ad(z)| < 1, it follows that ty, < 1 as 
desired. 


For part (2), let s == ep +y with (y, M) =0, t> k; then 
Y = È (tyly + Syby) 


where ty = 0 if y = yen’ °°, ym We observe that [ep, 4] = z for i= k +1, 
+m. Then 
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[z, z] =2 + È try y)/ (yo y) (iby) 
+ > Sy (% ¥)/ (Ye y) (— iay) +E 


where K is as above. Thus ad(z)z;=2,-+ w, where we see at once that 
H(a,w) =0. It follows that |ad(2)s |? = |u|? + |w |? and since | ad(z)| 
<1, we must have w=0. This implies that t,(y, yi) =5y(y, yi) =0 for 
t=k+1,:--,m. Then if ty or s540 we must have (y,y) <0 for 
t—k-+1,--+-,m, and so X.,€p(D). Thus we must have y€ po(D). 

We recall now the first of Pyatetskii-Shapiro’s definition of a boundary 
component. 


Definition. A subset f of 9D is an analytic boundary component of D 
if it is a regular analytic set in p, contained in @D such that if &(z), |z| <€ 
is a holomorphic curve lying in 6D with $(0) €f, then (z) €f for all z. 

Hereafter D will denote a set Dy k—=0,1,- --,m—1. 


THEOREM 6. If f ts any set of the form k-in(sp) there is complex affine 
subspace H in p, such that HN D =f. The interior of HN D in H is f 
and f is a bounded symmetric domain in H with a Harish-Chandra embedding. 


Proof. We mean by the final statement that we can choose a point (an 
origin) in H and thereby give H the structure of a complex vector space, 
and that f is embedded in this vector space by a Harish-Chandra embedding. 

Since K acts by unitary transformations, it is enough to prove the theorem 
for f ==in(Sn). In this case we let H = ep -+-p,(D) and take ep as the origin 
in H. It is clear that FC DAH. On the other hand if Pe DN, then 
|ad(P)| 1. We write Pep +P, with P,€p.(D). If x€ g(D), then 
[en, £] == 0 and so 

ad(P) lao =ad(Pı)|am- 


Thus |ad(P3)|gcp)| 1 and by Lemma 4.5, P,€zn(Sp). It follows that 
Pef,andthtf—=DNH. The final statements of the lemma are immediate 
consequences of Lemma 4. 4. 


THEOREM 7. The analytic boundary components of D are exactly the 
sets f of the form k-in(Sp), kEK. 


Proof. We first observe that Theorem 6 implies that any set of the 
form f above is a regular analytic set since it is locally the zeroes of the 
hyperplane H. Since the sets of the form f exhaust dD it suffices to prove 
only that each one of them is an analytic boundary component. Further it is 
enough just to prove that ip(Sp) is one. 
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Let #(z), |z| < ebe a holomorphic curve in 9D such that ¢(0) =p € f. 
Since G(D) maps 6D and f onto themselves and is transitive on f, we may 
assume without loss of generality that ¢(0) —en. Then we.can write 


(2) = 3i(¢s(2) as + ye(z)bs) (BE Pt) 


where ¢g and yg are harmonic functions. By Lemma 4.6(1) | ¢y,(z)|S1 
since ¢(z)€ D. On the other hand, ¢y,(0) 1 for i=k +1,  -,m, and 
by the maximum principle $,,(z) = 1 for all z. Therefore (2) ep + dı (2) 
where ($1(2),4) =04>k. By Lemma 4.6(2) we must have ¢1(2) € po(D) 
and so ¢(z) € f in the notation of Theorem 6. We know that f is a bounded 
domain in H, and if (zo) € f—Ff for some 2, (z) would be entirely con- 
tained in the closure of some “boundary component” of f. This is impossible 
since $(0) ep. Thus #(z) € f and the theorem is proved. 

Pyatetskii-Shapiro has given an alternate definition of boundary com- 
ponents in terms of a metric on D. Let p be the Riemannian metric on D, 
then if p,gé J, let 

p(p, q) = inf (lim sup p (Ps, qn) ) 


where the infimum runs over all pairs of sequences p, and g, which converge 


to p and q in the Euclidean topology on D. Then p is a metric on ®. 
(We allow metric functions to take the value +.) 


Definition. The mertic components of 6D are the connected components 
of the mertie p on 0D. 

We shall show that this definition yields the same objects as the previous 
one. Further we shall give a simple criterion for two points to belong to 
the same boundary component. 


Lemma 4.7. Any set of the form f=mk-tp(Sp) is p-connected. 


Proof. Since G acts isometrically on 9, it is enough to prove that 
in(Sp) is p-connected. Let g be the three-dimensional complex algebra 
spanned by Xy» X_y,, yọ and let go be its intersection with go If 
D' —=2z( TL exp(go)K) it is known ([8], III) that D’ is an m-dimensional 

4=1 
polycylinder which is embedded totally geodesically in D. The metric p 
restricted to D’, p’ is a Riemannian metric invariant under the connected 
component J] exp(go“) of analytic automorphisms of D’. Let p also denote 
4a 2 
the extension of p’ to D’. Then it is easy to see that a p’-connected subset of 
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6D’ is p-connected as a subset of OM. It is known, however, by explicit 
calculations that 


Tom ($ru Jal <1} 


is a p’-connected, set of 6D’ containing en. Thus T is p-connected, and if 
kEK(D), k-T is also p-connected and contains ep. Finally it follows that 
tp(Sp) —U&-T (ke K(D)) is p-connected. 

We recall that g is the homeomorphism of M=—¢n(G/K) onto D. Let 
m= g? so that m(p) for pe D is the “Poisson measure” on the Shilov 
boundary S of D which represents p. If u and v are two mutually absolutely 
continuous probability measures on 8, let 


A (æ v) = ess sup (log (dv/dp)). 


Lumma 4.8. There is a positive constant c such that for any p,q €D 


A(m(p),m(q)) S cp (p, 4). 


Proof. Since A(h- m, h'v) =A(m, v) for hE G and since p is invariant 
under G, it is enough to prove the lemma when p—=<2(K) and q = z(exp(H)K) 
with HEA. Then m(p)= p, the K invariant measure on 8 = G/B (E), and 
m(q) =a: p where a == exp (H). 

Let x, is the K invariant measure on G/B, the maximal boundary of 
Furstenberg, and let h be the projection of G/B onto S. Then h(po) =p 
and A(vo) =v where vp==@- uo. It is clear that 


sup (dv/du) = sup (dvo/ dpo) 


Now since a € exp(A), one can see that the maximum value of dvo/duo occurs 
at B in G/B and that this maximum value is exp(2a(H)) where « is half the 
sum of the positive roots of g with respect to h. (cf. [16], p. 281, [3], p. 241). 
Thus A(u,v) SS 2a(H). 

On the other hand, the Riemannian distance in G/K from K to a-K is 
clearly V (H, H) where ( , ) is the Killing form of go. In order to complete 
the proof, we choose c so that V (H,H) 2=c2a(H) for HEA. 


We can now prove our final result. 


THEOoREM 8. The sets of the form f—k-in(Sp) are the metric com- 
ponents of 8D. Moreover tf pqE D, then p and q belong to the same 
metric component if and only tf m(p) and m(q) have the same support. 
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Proof. It follows from [13] that m(p) and m(g) have the same support 
if and only if they lie in the same set k-ip($p). Thus the first and second 
statements are equivalent. From Lemma 4.7 we know that if m(p) and 
m(g) have the same support, they lie in the same metric component of 8D 
since we proved there that &-tp(Sp) is connected. 

It suffices then to prove that if p and q lie in the same metric component, 
then m(p) and m(g) have the same support. If p and q lie in the same 
component, then clearly p(p,g) <0. Therefore we can find sequences fp 
and qa in D tending respectively to p and q such that p(Pm a) SM <. 
By the previous lemma, 


dm (pa) /dm (qu) S oxp (cM) —K, 


or alternately Km(qn) Zm(m). Since m(q) and m(p,) tend to m(q) 
and m(p) in the weak-* topology, it follows that Km(q)=m(p). By 
symmetry Km(p) = m/(q) and it follows that m(p) and m(g) are mutually 
absolutely continuous and in particular that they have the same support. 
Let % denote the Banach algebra of continuous complex valued functions 
on ® which are holomorphic in D. The maximal ideal space of M is D. In 
[17] Gleason has defined the notion of a part of a maximal ideal space. 


If p and g are in 9D, then we say that p~q if 


sup _|f(p)—f(g)| <2 | f|=sup|f()|. 
Iren fe sd 


It is proved that ~ is an equivalence relation and the equivalence classes 
of this relation are defined to be the Gleason parts of D. The following is 
not unexpected and not difficult to prove. 


THEOREM 9. The Gleason parts of D are D together with the boundary 
components of 0D. 


Appendix. 


Koranyi and Wolf [11] say that an irreducible Cartan domain G/K is 
of tube type if it can be realized as a tube domain over a self dual cone. 
They show that G/K is a tube domain if and only if alternative (1) of 
Theorem 2 holds, or equivalently, if and only if — $y: is not in (R) (R is 
the set of roots of g with respect to a). In the following, boundary com- 
ponent means only those of positive dimension. 


Tarore». (1). If Q/K is of tube type, then each boundary com- 
ponent ts of tube type. If G/K is not of tube type then no boundary 
component ts of tube type. 
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(2) AU boundary components are classical domains. 


Proof. For our purposes, we may take a boundary component f of the 
form ip(8p) with D non void. Then D=D; with k>0 and the connected 
group of isometries of Sp is essentially @(D). By Lemma 4.3 and the dis- 
cussion preceding it, the roots of g(D) with respect to a(D) are those roots 
B of g with respect to a such that (8, y:i) =0 for t+—&+1,---,m. 


(1) If Q/K is of tube type we have alternative (1) in Theorem 2 for 
a(R), and by the remark above, alternate (1) holds also for the roots of g(D). 
Thus Sp is of tube type. The second statement of part (1) follows in the 
same way. 


(2) We consider the case when @/K is exceptional. There are two 
exceptional domains: one of dimensional 16 which is not of tube type, and 
one of dimension 27 which is of tube type. If Q/K is exceptional of dimen- 
sion 16, all boundary components are of lower dimension and hence classsical. 
If Q/K is exceptional of dimension 27, all boundary components are of lower 
dimension and of tube type, hence classical. 

To complete the proof, we must show that if G/K is classical, then each 
G(D)/E(D) is also classical. We recall that a,,:--,a, is a fundamental 
system of roots of g with respect to h using the ordering described immediately 
after Theorem 2’. Then some subset S of a,‘ - -,% will be a fundamental 
system of roots of g(D) with respect to h(D) (cf. [15]). Let g(D) be the 
unique non-compact component of g(D). Then if G(D)/K(D) is not 
classical, $(D) is an exceptional Lie algebra. If 8 is its highest root, then 
B= E me (a€ 8). It is known that for at least one i, n,>2. On the 
other hand, £ is a root of g, and since g is classical, al, <2. This contra- 
diction establishes the Theorem. 
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SHEAVES DEFINED BY DIFFERENTIAL EQUATIONS AND 
APPLICATION TO DEFORMATION THEORY 
OF PSEUDO-GROUP STRUCTURES. 


By MASATAKE KURANISHI. 


For a vector bundle Æ over a manifold V, denote by S(#) the sheaf of 
germs of local cross-sections of E. By using local coordinate we may consider 
linear differential equations on F. When V=~R* and E= V XR", the 
linear differential equations on F are linear differential equations on m 
unknown functions in n variables. The germs of solutions of a linear differ- 
ential equation on E forms a subsheaf, say G, of S(#). The importance of 
such subsheaves @ can be seen, for instance, in the recent works of Kodaira 
and Spencer in the deformation theory of pseudo-group structures. In the 
first half of the present paper, we study some of properties of such. sheaves. 
Since it is very difficult to treat the general case, we restrict ourselves to the 
category of real analyticity and to the case where inconvenient degeneracy does 
not occur in the differential equations. In our argument these restrictions 
are necessary because in the last analysis we depend on Cartan’s theorem of 
solvability of involutive real analytic differential equations. G together with 
its defining linear differential equation which is nondegenerate, is called a 
(9)-sheaf. Our main result is the existence of quotient (S)-sheaves of (9)- 
- sheaves by (S)-subsheaves. In the second half the writer gives concise descrip- 
tion of how the above results can be applied to deformation theory of transitive 
continuous pseudo-group compact structures. Since our argument follows the 
more or less well known line developed in [3], details are omitted. It is 
noted that another approach, which is still within the same framework as ours 
but which is more differential geometric, is published in [5] by D. C. Spencer. 

In the present paper every notions are assumed to be in the category of 
real analyticity. So when we say manifolds or mappings for example, we 
mean always manifolds or mappings which are real analytic. 


1. Differential equations and sheaves of type (S). Let N and N’ be 
manifolds. Take a mapping = of N’ to N. We say that the triple (N,N, x). 
is a fibered manifold when ~ is surjective and the rank of dr at each point of 
N’ is equal to the dimension of N. When that is the case, for any point p 
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of N’ there is a neighborhood U’ of p’ and a coordinate (a1,---, 2", y',---,4™) 
defined on U’ such that there is a coordinate (’z},- - -,’a*) defined on (U’) 
satisfying the equality: 'zt = atom. Such a coordinate (z, y) is called a coordi- 
nate of the fibered manifold (N’,N,r). As far as no confusion can occur, 
we use zt instead of ^st, Let J!(N’,N,r) be the space of l-jets of local cross- 
sections of (N’,N,7). J'(N’,N,) has the canonical manifold structure. 
Denote by « and 8 the source and the target mappings, respectively. Setting 
J! =J! (N,N, x), we see easily that 


(JN, a), (J',N’,B), and (JN X N’,aX B) 


are fibered manifolds. We have the canonical projection pty of J? onto J} 
(=v). (J?,J",p'v) is also a fibered manifold. J° can be canonically 
identified with N, and a with m. Let (z,y) be a coordinate defined on U’ 
of (N’, N, 7). Then J+ has the canonical coordinate (z,y,p) defined on 
B(U’) as follows: Take X = js! (f) in 8*(U’), where f is a cross-section over 
a neighborhood of z Express f in terms of coordinate (2, y) as A=fX(z), 
à= 1,:-,m. Then 


Pur) — (8fr/824- ü SL) PER 
s(X) =t (2), (X) => (f(2)), 
iis i=l, n andySi. 


Thus pM,- is symmetric in h,’ * -,1, The coordinate (z, y, p) is said to be 
associated with (z,y). For a cross-section f of (N’,N,r) over an open set U 
of N, denote by 7'(f) the cross-section: U3 z— ja’ (f) € J? of (J1, N, a) over 
U. Let U be an open subset of J!. Denote by (U) the space of Pfaffian 
forms w on U such that jt (f)*w — 0 for any local cross-section f of (N’,N, ~) 
with the image of j!(f) in U. If UD W, the restriction mapping send 
(U) tow(U’). Thus the system II(U) defines a subsheaf, say I(l, (N’, N, )), 
of the sheaf AJ‘ of germs of differential forms on J!. The following proposi- 
tions are well known. 


- Proposition 1.1. I(l, (N’,N,7)) is locally finitely generated over the 
sheaf APJ! of germs of functions. More precisely, if (x,y) is a coordinate 
of (N’,N,r) defined on U’ and if W is an open subset of B+*(U’)), then 
I(W) ts generated by 


wh — dy — pr de! 
We tp = OD yy — Dy yp WE). 
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Proposition 1.2. Lei F be a local cross-section of (JY,N,a). Then 
there is a local cross-section f of (N’,N,r) such that F=j!(f) if and only 
if F*w—=0 for any open set U of J? and for any w in x(U). 


Definition 1.1. By a partial differential equation of order J on (N’,N,r), 
we mean an open subset U of JY(N’,N,r) and a subsheaf X% of ideals of 
A°U which is locally finitely generated over APU. A local cross-section f of 
(N’, N,2) is called an integral of 3 when j!(f) is in the set of zeros of 2. 

By a locally closed subvariety W of a manifold N” we mean a subset W 
of N” satisfying the following condition: For every point p of W we can find 
an open neighborhood U(p) of p in N” such that W N U (p) is the set of 
zeros of a finite number of functions defined on U(p). When this is the case, 
let U be the union of all such U(p) where p runs through W. Then W isa 
closed subset of U. Thus for a locally closed subvariety W of N” there is 
an open subset, say U, of N” such that W is a closed subset of U. Let A be 
a locally closed subvariety of J'. Take an open subset U in J? such that A 
is closed in U. Denote by %(A) the subsheaf of A°U consisting of all germs 
of local functions which vanish on A. %(A) is a subsheaf of ideals of AU. 
Then %(A) is a differential equation of order J on (N’,N,r), which is said 
to be associated with A. A will be also referred as a differential equation, 
meaning 3(4). %(A) is not uniquely determined by A because the above 
choice of U is not unique. However, this indetermination is of no importance 
to our discussion. For a differential equation 3 of order J on (N’,N,r), the 
set I°S of zeros of X is a locally closed subvariety of J!. Clearly%(I°%) D3. 

Let (z,y) be a coordinate in (N’,N,2) defined on U’. Let g be a func- 
tion defined on an open subset U of 87(U’) CJ*. Then gop"; is a function 
on (p) (U) and d(gop'*,) is a linear combination of dat, dy, dp,,...4, 
(v1). Hence by Prop. 1.1, . 


(1) d(g o pi) == gy da! (mod H(7-+-1; (N”,N,=))) 
where g; is a function defined on (pt) (U). We set 
(2) 8ta! (g9) = g3. 
When (z,y) is changed to (z, w), dzi = a,/d2* and so 
8# (g) = aP (8*2 (9)). 


Let F be an ideal of the ring R(U) of functions on UC J’. Denote by P(F) 
the ideal in R(p*,)*(U)) generated by gop; and 8f (g), j=1, -,n, 
where g runs through F. The above rule for changes of coordinates shows 
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that P(F) is independent of the coordinate used in the construction. Let X 
be a subsheaf of ideals of A°U. For an open subset U of U the space 
T(U,2) of sections of % over W is an ideal of R(U’), and so P(T(U’,2)) 
is defined. If W DUW’, the restriction mapping sends P(T(W,2)) to 
P(T(U”,3)). Thus the system {P(T'(U’,%))} defines a subsheaf of ideals 
of A°((p**;)-+(%)), which will be called the standard prolongation of % and 
will be denoted by P(X). P(2) is a differential equation of order 7+ 1 on 
(N’,N,r). Let A be a locally closed subvariety of J. If P(2(4)) 
== ¥(I°P(3(A))), we say that the standard prolongation of A can be defined. 
When this is the case, [’P(32(A)) is denoted by P(A). The following 
proposition and lemma are easy to check. 


Proposition 1.3. Let 3 be a differential equation on (N’,N,r). A 
local cross-section f of (N’,N,r) is a solution of Z if and only if f ts a 
solution of P(2). 


Lemma 1.1. Take a coordinate (x,y) defined on U’ of (N', N,v). 
Let f be a local cross-section of (N°, Nym) such that the image of f is in U”. 
Denote by & a function defined on a neighborhood of the image of j*(f). 
Then ; 

(BEN) N). 


Let % be a differential equation of order J on (N’,N,xr). Denote by U 
the open subset of J? on which X is defined. Let %* be the subsheaf of ideals 
(closed under the exterior differentiation) of AU generated by % and by the 
restriction to U of I(l, (N’,N,r)). We say that X is in involution, when 
%* is an exterior differential system in involution. It is well known that if 
X is in involution then so is P(X). A locally closed subvariety A is said to be 
in involution when %(4) is in involution. If this is the case, A is a locally. 
closed submanifold, P(A) is defined, non-empty (provided A is non-empty), 
and is in involution. Hence P(A) is also a locally closed submanifold. 


Definition 1.2. Let A! be a non-empty locally closed submanifold of 
T(N, N, 7), =h. Take Xt in At. We say that the sequence {A}, ¥4;7 > 1,} 
is normal when the following conditions are satisfied for each 12 4: 

DL, 

(2) there is an open neighborhood U of X* such that the restriction 
of P(2(A!)) to U is contained in Z(A*), 


(3) we can find an open neighborhood "U! of X? such that (Urin A™, 
UN Ar, p',) is a fibered manifold, 
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(4) there is an open neighborhood U of X% such that (UN An, a (U), «) 
is a fibered manifold. | 


A normal sequence is called strictly normal when P(A?) is defined and coin- 
cides with A" on a neighborhood of X* for any 1=1,. The following is 
proved in [4]. 


TuEormm 1. Let (Al, X+; lZ L} be a normal sequence. Then there is 
an integer la = 1, such that, for any l= l, there is a neighborhood U} of X! 
such that UN A? ts in involution and P(3(A+)) coincides with ¥(A4*) on 
a neighborhood of X*. 


By the existence theorem of solutions for involutive system, we have the 
following corollary: 


ÜoROLLARY. Under the same assumptions as in Theorem 1, for any fixed 
t= 1, and for any X in A! sufficiently near Xt, there is a solution f of the 
differential equation Z(A!) such that j,'(f) =X where p=a(X). 


Let (E,N, r) be a vector bundle. Then (J!(E,N,r),N,«) is also a 
vector bundle over N. As far as no confusion can occur, we write J!(E) 
instead of JH(E,N,r). By a linear differential equation of order l 
in (E,N,r) we mean a vector sub-bundle (B,N,a) of (J!(E),N,«). Denote 
by Op? (pe N) the Ljet at p of the zero-section. A sequence B} (Ih) of 
linear differential equation of order } in (E,N,r) is said to be (strictly) 
normal when the sequence {Bt}, O,';1= 1,} is (strictly) normal for any p in N. 
A linear differential equation B of order 1, in (#,N,7) is called weakly 
involutive when there is a strictly normal sequence {B';]=1,} such that 
Bux BL, Let ®(E) be the sheaf of germs of local cross-sections of (E, N, r). 
Denote by ©(#,B) the subsheaf (of ®(E)) of germs of integrals of B. If B 
is weakly involutive, ®(E,B)—=®(E,B!) for II, by Prop. 1.3. Let 
(E’,N’,#’) be a vector bundle. 


Definition 1.3. Let B (resp. B’) be a linear differential equation in Æ 
(resp. Æ’). Denote by f a mapping of N to N’. A continuous mapping a 
‘of @(H,B) to (E, B’) is said to be a linear differential mapping (over f) © 
when we can find integers l and k such that for any 1 = max(l,,%) there is a 
fiber preserving mapping a,* of J!(E) into J'*(#’), which induces f on the 
base spaces and linear mappings on fibers, and which satisfies the following 
condition: For any local cross-section f of @(i, B) 


HUMAN). 
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Leuma.1.2. Keeping the notations in Def. 1.3, assume further that B’ 

is weakly involutive and that a is a surjective mapping of @(H, B) to 8(E’, B’). 
"Let (resp. L’) be the order of B (resp. B’). Then for sufficiently large I 
the image of P'-h(B) by a;* ts equal to P*-4'*(B’), where Pk denotes k times 
iteration of the operation P. 


Proof. By Prop. 1.3 and Theorem 1, we can assume that B’ is in involu- 
tion. Otherwise replace B’ by Pr(B’) with a sufficiently large r. Then our 
‘lemma is an immediate corollary of the existence theorem of solutions for 
involutive systems. 


Definition 1.4. Keeping the notation in Def. 1.3, assume further that 
B is weakly involutive. Then we say that a is regular when, for a suitable 
choice of a,* (i.e. of k), C!==B!N (the kernel of a;*) is a vector sub-bundle 
of J'(H#) and (C1, C+, p™t,) is a fibered manifold for sufficiently large l, 
where B! == P'h(B) and l is the order of B. 


Definition 1.5. By a (S)-structure F on a sheaf F (of modules) over N 
we mean the following: (1) For any open subset U of N with compact closure 
we are given a vector bundle (E (F,U),U, =) and a weakly involutive linear 
differential equation B(F,U) in (E(F,U),U,r) together with a homeo- 
morphism igy of F over U onto @(#(F,U),B(F,U)). (2) for any U D U’ 
the mapping ı$7° yo" is a regular linear differential mapping over the 
canonical injection of U’ into U. 


Let F be a (8)-structure on F. We regard F’ is equal to F when 
P*(B(F,U))=P®#(B($’,U)) for a suitable choice of k and K’. 

F will be called the underlying sheaf of the (S)-structure F. When 
there is no possibility of confusion, we use F to denote the (8)-structure as 
well as the underlying sheaf. A sheaf with a (9)-structure will be referred 
as a (S)-sheaf. 


Remark. When N is compact, we may restrict ourselves to a special case 
of (S)-structure where E(F,U) (resp. B(F,U) is the restriction to U of a 
vector bundle E over N (resp. a weakly involutive differential equation B). 
Then the subsequent arguments are somewhat, but not essentially, simplified. 


Definition 1.6. Let F, and F, be (S)-sheaves over N. Let a be a con- 
tinuous mapping of F, to F} We say that a is a (S)-mapping when the 
following is satisfied: For any open subset U of N with compact closure 
uty OQO g is a regular linear differential mapping of @(H#(F,, U), B(F,,U)) 
into @(H(F,,U)). 
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Let F, be a subsheaf of a sheaf F with ($)-structure. We say that F, 
is a (S)-subsheaf of the (S)-structure when there is a weakly involutive 
sub-bundle B,(U) of B(F, U) for any open subset U of N with compact closure 
such that iry induces a homomorphism of F, over U onto @(E(F, U), B,(U)), 
provided we replace B(F,U) by its standard prolongation if necessary. Then 
by Lemma 1. 2, we see that by associating #(F,U),B,(U), and the restriction 
of ıpu to F, over U for each U we have a (S)-structure on F,. In the following, 
a (S)-subsheaf of a (S)-sheaf will be always considered as a (S)-sheaf in 
the way mentioned above. It is clear that the canonical injection of F, into 
F is a (S)-mapping. Let G, (t—1,2,3) be a ($)-sheaf over N. Denote by 
b (resp. c) a (S)-mapping of G, to G, (resp. G, to G,). Assume that b is 
surjective. Then it is easy to check that the composition cob is again a (S)- 
mapping. Let E be a vector bundle over N. Then the sheaf ®(E) has an 
obvious (S)-structure. Then the canonical mapping j' of @(E) into @(J4(E)) 
isa (S)-mapping. Take a homomorphism a of a vector bundle E to a vector 
bundle Æ’ such that the kernel is a vector sub-bundle of Æ and which induces 
the identity mapping on the base space. Then a induces a mapping of (E) 
to ©(#’). It is not hard to check that this mapping is a(S)-mapping. 


2. Properties of (S)-sheaves, 


Turormm 2. Let F, and F, be (S)-sheaves over a manifold N. Take 
a continuous mapping a of F, to Fs. If ats a (S)-mapping, then the kernel 
of a and the image of a are (S)-subsheaves of F, and Fa, respectively. 


Proof. Take an open subset U of N with compact closure. We can 
assume that F; over U is equal to @(H;, B;), where E; is a vector bundle over 
U and B; is a weakly involutive differential equation in F; (#=1,2). More- 
over, we can assume that a over U is a regular linear differential mapping. 
Using the notations in Definition 1.4, we set C! == B,!n (the kernel of a,*). 
By the definition, O? is a linear differential equation in Æ, and the kernel of 
a over U is equal to ©@(E,,C!). Hence, in order to prove that the kernel of a 
is a (S)-subsheaf it is sufficient to show that, for any subset U’ of Ọ such that 
the closure of U’ is in U, C! over U’ is weakly involutive for sufficiently 
large 1. (Note that the closure of U is contained in an open set U, with 
compact closure). Because of Theorem 1, to prove the above, it is sufficient 
to show that P(3(C')) C3(C"),. To check this, take X in U! and a 
function ¢ defined on a neighborhood of X’ == p'*1,(X) in J!(E,) and which 
vanishes in the intersection with C*. Let (z,w) be a vector bundle coordinate 
of J'*(#,). We have to show that [8fsp](X)=-0. By the definition of 
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Ct, @ is a linear combination of woa,*. Therefore we can assume that 
= wom”. Take a local cross-section f of E, such that X = jp’ (f). Then 
by Lemma 1.1, we have 


[8ta] (X) = (8/82*) (wa (G (F)))) 
= (8/d2*) (wX(j'*(a(f)))) 


which is one of fiber component of a vector bundle coordinate of 7,""*(a(f)) 
= 4,1*(X). On the other hand, since X is in C**, ay,*(X) == 0 and hence 
it follows that [8*.+¢](X) =0. Thus P(%(C')) C %(C"), and so we proved 
that the kernel of a is a (S)-subsheaf. 

Set At =— a,,* (Bı"*). By the condition in Definition 1.4, A! is a vector 
subbundle of J#(H,). It is clear that the image of @(#;,B,) by a is in 
@(H.,A*). We claim that P(&(A')) C3(A™). Namely, take X —=dyeu*(V), 
Y € B,Y#*, in A, Denote by ¢ a function defined on a neighborhood of 
X’ =m pt, (X) in J!(E,) and which vanishes on the intersection with A‘. 
Let (x) be a coordinate in N on a neighborhood of z= a(X). By the 
existence theorem of solutions of involutive system, we can find a cross- 
section f of ®(E,,B,) such that jett (f) =Y. Then Z=j.''(a(f)) and 
0— p(due*(7"*(f)) =p (F (a (f)). Hence 


[otep] (X) = (E (H (F (a (f) ) ) N = 0. 


This shows that P(3(41)) C3(A**), Therefore by Theorem 1.1 there is 
an integer l, such that for t= l, A! is weakly involutive and 8(E,,A!) is 
equal to @(FE,, A=). Thus, in order to prove that the image of F, by a is a 
(8)-sheaf, it is sufficient to show that the image of ®(#,,B,) is equal to 
© (#2, At). 

Now, take a local cross-section g of @(H,,A%). Set 


K! = {X E Bt; a;*(X) — jp'*(g), p= a(X)}, 


where p runs through the domain of g. K? is a locally closed subvariety of 
J(#,). Take Xoin K'withp=a(X,). Then clearly a(p) N K! =X, + C4 
Hence K! is a locally closed submanifold of J'(#,) and (Kt, Kt, o"t) is a 
fibered manifold. Set Y'==j,'(g) and choose X? such that a,*(X') == Yht 
and p(X) =X. If we can prove that for a sufficiently large I there is 
a local cross-section f of ®(E,,K!) such that jp! (f) = X?, then f is a cross- 
section of ®@(E,,B,) and a(f) =g on a neighborhood of p and so we can 
confirm that the image of a is a (S)-subsheaf. To see that such f exists, again 
by Theorem 1.1 it is sufficient to show that P(%(K')) C3(K*"). Take a 
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coordinate (z,w) of J**(H#,) and a function ¢ on an open subset in JHE) 
which vanishes on the intersection with K'. Then ¢ is a linear combination 
of functions A, where WW) = w*(a;*(W)) —w*(jacw)**(g)). Then the 
similar argument used above works here. Thus we proved that the image by 
a is a (S)-subsheat. 


Tuxorem 3. Let F bea (8)-sheaf. Take a (S)-subsheaf G of F. Then 
the quotient sheaf F/Q has a (8)-structure such that the canonical projection 
of F to F/G is a(8)-mapping. Moreover such (S)-structure on F/G ts 
unique up to isomorphism. 


Proof. We can assume without loss of generality that F=®(E,A) and 
@=®(E,B), where # is a vector bundle and A, B are weakly involutive linear 
differential equation of order Z on #. In order to prove the existence of a 
(8)-structure on G/F satisfying the required condition, we set B* == P**(B) 
and A* = P*ř-I(A) for k= 1. 

We have (S)-mappings 


jt: @(E) >@(J'(B)) and b: @(J'(B)) > @(J'(E)/B), 


where b is the canonical projection. Set c=boj!. Clearly ¢ is a linear 
differential mapping and represented by a vector bundle mappings cë of 
J*(#) into J*?(J'(#)/B*) for k=l. By direct checking, we see easily that 
the kernel of ¢,* is B¥. Since B*C A* and B* is weakly involutive, it follows 
by the definition that c: F>®(J!(E)/B) is a (S)-mapping, where we denote 
by c the restriction of the original-c to F=®(E,A). Since the image of this 
c is isomorphic to F/G, it follows by Theorem 2 that F/G is a (S)-sheaf. 
In order to show the uniqueness, let H, be a (S)-sheaf together with a 
surjective (S)-mapping ct of F to H; with kernel G, i==1 and 2. We may 
assume that H = @ (E, Bı) and ct is induced by a mapping o,'* of J!(E) to 
J'%+(H,). Denote by Bi the prolongation of B; in J'(#,). For a sufficiently 
large ! take an element X in B,. By Lemma 1.2 and the surjectivity of c’, 
there is an element Y in B=% such that du (Y) =X. Set rı(X) 
= Cun (Y). We claim that v, is a well defined bundle mapping of B? to 
B,'*kık, Namely, since the kernel of the mapping c*,* on B? is the equation 
of G as is shown in the proof of Theorem 2, for any W in B44 such that 
Cum” (W) == 0 there is a cross-section g of G over a neighborhood of a(W) =p 
such that W—j,*(g). Hence ?yu*(W) = jpt*(c?(g)) = 0. Therefore - 
7, is well defined. ~ is surjective because we can go backward using Lemma 
1.2. Extending 7; to a bundle mapping of J!(E,) to J"#rk(E,) we obtain 
a (8)-mapping c* of H, to H, such that c,—-c*oc,. This shows that (9)- 
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structures on F/G which satisfy the required conditions are unique up to 
isomorphism, q. e. d. 


3. Deformations of compact pseudo-group structures, Let T be a 
transitive continuous pseudo-group operating on R*. Take a T-structure V 
defined on a compact manifold V. Then the structure induces a continuous 
pseudo-group T(V) on V, i.e. the set of local transformations of V such that 
their expressions in terms of T-structure coordinates of V belong to T. Denote 
by £ the sheaf of germs of local vector fields belonging to T(V). Then there 
is a weakly involutive linear differential equation B of order 1, in the tangent 
vector bundle T of V such that ¥ is equal to 8(T,B). For 1 1,, denote by 
B! the prolongation of B to J!(T). Then the arguments in §2 (especially 
the proof of Theorem 3) show that we have an exact sequence 


i D D 
(4): 0 @(T, B) —> 0(T) —=> @(J(T)/B') — 
@(J*(J* (2) /B*) /C*) 


where + is the canonical injection, k is an integer, C* is a vector sub-bundle 
of J*(J'(7)/B"), and D’s are the composition of the canonical projections 
and the jet mappings. Moreover, the image by D of ®(T) is equal to 
@(J*(T)/B*, Ct). We set 


By=_JUT)/BY B, =J (J (T) /B}) /C. 


Let V’ be another T-structure on V sufficiently close to V. Our first concern 
is to associate a section w(V’) over V of @(#,) with V’ in such a way that 
sections thus obtained are characterized. by a certain equation. Unfortunately 
the writer does not know any canonical method. for doing this. One way is 
to assume that V’ can be joined to V by a family and to use exponential 
mappings, but the result seems to depend on how you join V’ to V. Here 
we use a method depending on a choice of certain decompositions in jet spaces. 
To do this, we remark that the space of invertible l-jets of V, say @(F), 
is an open subset of J'(J°(V),V,a) and the set of l-jeta (for LÈL) 
belonging to T(V) is a submanifold, say At == J! (T(V) ), of Œ (V), i.e. T(V) 
is the set of integrals of the differential equation A‘. We can form the 
coset manifold G#(V)/A* by means of the composition of jets, elementa of 
which are cosets (A!Na'(p))oX where XZe@!(V) with p= A(X). 
(G'(V)/A4,V,a) is a fibered manifold. Denote by I!(p) the I-jet of 
identity mapping at p of V and by ’/!(p) the image of I'(p) by the canonical 
projection of G#(V) to E!(Y)/A!. Set 
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P(Y) =U {I(p);pe V} and PM =U {I (p);pE F}. 


Similarly we define O'(p), ’O!(p), O'(V), and ’0'(V) using l-jets of the 
zero vector field and the factor vector bundle F, = J!(T)/B!. Since local 
vector fields can be considered as the differentials of one-parameter family of 
local transformations at the identity mapping, there is a canonical isomorphism 
t” of the tangent vector space to G4(V) N a?(p) at I'(p) with J!(T) over p. 
t” sends the tangent vector space to A'Ma*(p) at I'(p) to B! over p. 
Therefore r” induces an isomorphism r’ of the tangent vector space to the 
fiber of (G'(V)/A*, Y,a) at ’I*(p) with E, over p. Therefore we can find 
an open neighborhood U of ’I'(V) in @!(V)/A!, an open neighborhood U 
of ’O!{V) in E,, and a homeomorphism r of (U, V,a) with (U, V,a) which 
induces the identity mapping on the base space V and such that dr is an 
extension of the above 7°. r induces a homeomorphism (r) of J*(U) 
= J*(U,V,a) onto J*(U) —=J*(U, V,a). (U) and J*(U) are open sets 
in J*(G*(V)/A*) and J*(H,), respectively. We constructed the vector sub- 
bundle O! of J¥(H,), which characterizes jt(D(®(T))) ((1) and Theorem 2). 
By the same construction we find without much difficulty a locally closed sub- 
manifold H* of J*(@!(V)/A!) such that ¢ is a cross-section of H* if and 
only if is sufficiently close to j#(’I?) and ¢ = j*(j'(f) mod A"), where ’I! is 
the cross-section p—>‘I'(p) and where f is a local transformation of V suff- 
` ciently close to the identity mapping. We can assume that H* is in J*(U). 
Clearly d(j*(r)) induces the homeomorphism of the tangent vector space 
to the fibre of (H*,V,a) at j7,*(’Z') with the fiber in C* over p, i.e. 
F(r)(HFNat(p)) and O! N a>(p) has the same tangent vector space at 
O’(p). Taking a complementary vector sub-bundle K of C* in JE(E,) and 
denoting by r, the canonical projection to Ct of J*(E,) with the kernel K, 
we find that +, induces an homeomorphism of j*(r)(H*) onto an open 
neighborhood of the set of zeros in C* and induces the identity mapping on 
each tangent vector space at the zeros, provided we choose sufficiently small 
HF. Hence we can find a mapping r of C* into K such that the following 
holds: 


(i) r is fibers preserving and induces the identity mapping on the 
base space, 
(ii) X in J*(Z,) sufficiently near to a zero-jet is in j*(7) (H*) if and 
only if X —r(m.(X)) is in 05, 
(iii) 1(t&)=0 (mod ¢?), where ¢ is a real parameter and & is any 
element in CR. 
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Now we fix such r, K, and r once for all. Going back to a T-structure V’, 
we take a sufficiently fine covering U, of V. Choose coordinates a, on U; of 
the T-structure V and yı on U; of the T-structure V’. We assume that V’ 
is sufficiently closed to V so that the following arguments go through: Take 
a covering F; of V such that the closure of V; is in U, We may assume 
that yı == 2,99; on V; where g; is a homeomorphism of V; into U, .In the 
subsequent discussions we have to shrink V; a little more. But we will omit 
mentioning it. Then, since V’ is a T-structure, it follows that 


(2) Hog*Eer(V). 
Now set 
w= 7 (pa (j (94) )) 


where pa is the canonical projection of Œ (V) to @!(V)/AF. « is a cross- 
section of E, over V; Since (2) implies that j#(g,) = ayo jt (g;) with ay € A}, 
it follows that e= w; on VN V; Thus « determines a cross-section w( V’) 
of E, over V. By the construction o({(V’) is independent of the choice of 
coordinates and the covering. 

We will next characterize sections of F, stained by the above method 
. from T-structures. Let w be a section of E, over V sufficiently close to the 
zero-section. Then there is a T-structure V’ on V such that ow o(V’) if 
and only if we can find a system {g,} of homeomorphism g; of V; into U, 
such that 7*(w) on V; is equal to pa(j+(gi)), because the fact that pa(j*#(g9:) ) 
= pa(j'(g;)) on VaN V; implies giogyt€T(V). The condition is equiva- 
lent to say that w is an integral of the differential equation j*(r)(H*). Then 
by the property (ii) of r, the condition is equivalent to the condition: 


(3) Flo) —r(wo(j#(w))) € OF 


Now p.oro,oj*, where po is the canonical projection of J*(#,) to 
Es == J*(H,)/C*, defines a differential mapping (of order k) of pee to 
@(£,) which we denote by R: 


R = pe 0 rO 140 FF, 


Since D == p, © jk, the condition (8) is equivalent to the condition D(w) — R{w) 
== 0. Thus together with the property (iii) of r we have the following: 


PROPOSITION 2.1. Let w be a cross-section of E, over V such that F (w) 
is suffictently close to the zero section. Then there is a T-structure V’ on 
V such that o =o( V’) if and only if 
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(4) ‘D(o) —R(o) =0 


where D and R are differential operator of order k, D is linear and R(tw) —0 
(mod £). 


Thus the problem of local deformations of T-structure V is reduced to 
the problem of solving the differential equation (4). At present we do not 
know any effective way of solving the equation for general T. However the 
much of the known argument in the case of complex analytic structure can 
be carried over to T-structures provided V is elliptic in the following sense: 
For a suitable choice of } and & such that the above construction can be 
carried out and Proposition 2.1 holds, we can find a Riemannian metric in V 
and positive definite metrics along the fibers of the vector bundles T, J#(7') /B', 
and J*(J#(T)/B*)/C* in such a way that the differential mapping DD* + D*D 
of @(E,) into itself is elliptic, where D* is the adjoint operator of D with 
respect to the above metrics. Following the known argument we have 


THEorem 4. Let V be an elliptic T-structure on a compact manifold V. 
Denote by @(V) the sheaf of germs of local vector fields belonging to V. 
Then the space of infinitesimal deformations of V, which is equal to 
H*(V,@(V)), ts of finite dimension. If H1(V,@(V)) 0, any famiy of 
deformations of V is locally trivial at the reference point. If H?(V,@(V)) 
== 0, there is a family of deformations of V such that its space of infinitesimal 
deformations at the reference point is equal to H*(V,@(V)). 
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ON SIEGEL MODULAR FORMS OF GENUS TWO (I). 


By JUN-IOHI Iausa.. 


_ Introduction. The main subject we shall discuss in this second paper 
is the Siegel modular forms of genus two with levels. The method we used 
in the first paper [5] did not give sufficient information even for level two. 
Therefore the problem (raised by Grothendieck) whether modular varieties 
become non-singular or not for higher levels was beyond our reach. With 
some other applications in mind, we therefore investigated “ theta-constants ” 
as modular forms and proved, among others, a fundamental lemma in our 
recent paper [6]. Using the results in that paper, we shall show that modular 
varieties of high levels do not have non-singular coverings even locally around 
their singular points. Also we shall determine how T;(1)/T;(2) = Sp(2, Z/2Z) 
acts on the ring of modular forms A(T,(2)) and obtain the characters of its 
action on the homogeneous parts A (T'2(2)), for k = 0,1,2,: > +. In this way, 
we shall determine A(T,(1)) reproducing our earlier structure theorem on 
A(T,(1))®. Furthermore, the polynomial expressions of the four basic 
Eisenstein series of level one by theta-constants and a known identity of this 
kind (between a certain Eisenstein series of level two and the eighth power 
of Riemann’s theta-constant [1]) will be obtained. We note that this identity 
was previously obtained using the Siegel main theorem on quadratic forms. 


1. Normality of C[9,, 8,]. We shall use the same notation as in TC 
except that we have g==2 in this paper (and may omit g == 2 for the sake of 
simplicity). Also we shall sometimes treat characteristics as line vectors 
instead of column vectors (as in the case g==-1). We recall that theta- 
constants Om(7) are defined by putting z=0 in 


Bin (7,2) = ZB HKp+m’/2)r(p-+m’/R) 
+h (p + m/R%) (2 + m”/2)]. 
Also we shall denote the function r— Om (r) defined in the Siegel upper-half 


plane © by ðm. There are ten even characteristics mod 2 and they are (0000), 
(0001), (0010), (0011), (0100), (0110), (1000), (1001), (1100), (1111). 


Received October 11, 1963. 
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The purpose of this section is to prove the normality of the graded ring C[6m] 
generated over C by the ten “theta-constants.” 


Lexma 1. Let K be a field (of characteristic zero) and let K[X,T] 
be a ring of polynomials in ten letters Xy for 1S4,j=3 and T with coeffi- 
cients in K. Then the following twenty-one quadratic polynomials 


È XXi bhl, D LXi 8p 4.7" 
15158 18158 
(Xs Xt — KK uh) — Lil, 
in which the permutation (itis) > (jıjajs) is even, generate a prime ideal in 


K[X,T]. Moreover, if (x,t) is a generic zero over K, the integral domain 
K[a, t] is normal. 
Proof. We observe that we have an identity of the form 
det (Zu) — T? = Xa ( (X aXss — kee) T) 
+ Kal (Xs2X1s — XssL12) —XaT) 
+ Za ( (XX as — Isla) —Xail) 
+ un)? + (Xa) + (Za)? — PT. l 
Hence the first part becomes a special case of a known theorem and a proof 
can be found in Weyl [11, pp. 144-7]. We shall prove the second part. The 


main point is that every element of K’[z, t] can be written uniquely as a linear 
combination of monomials 


Top’ * 2,4,1° is: . ‘San: . > 


with coefficients in K in which za and zs; appear at most once. In order to 
make the argument clear, we consider the set of pairs of non-negative integers 
and introduce a lexicographic order in it. This set is well ordered. Then 
to each monomial Xu,‘ ‘Xes T° of K[X,T], we associate the following 
element (p, $ ta + (3—ja)) of the well-ordered set as its “weight.” Now 
we introduce three operations in K[X, T]. The first operation is 


Xt, A toly > Kuda + Zul 

whenever both u <i and jı <j: The second and the third operations are 
Kl baT’ ul 
LahA aa > 844,17 EEK 


We observe that, by the first operation each monomial is replaced by a sum 
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of two monomials one of the same weight and another of a smaller weight. 
On the other hand, by the two other operations each monomial is replaced 
by a sum of two or three monomials of smaller weights. If a polynomial in 
Xy, T is given, we apply the first operation repeatedly (as long as it can be - 
applied) and we get a new polynomial which is a linear combination of 
monomials Xap’ ° Xup T. in which 4, S---S,j,2---2jy. The new 
polynomial may be called “properly ordered.” We then apply two other 
operations and order properly the new polynomial so obtained. Because 
weights decrease by the second and the third operations, the process necessarily 
stops after a finite number of times. In this way, we get a properly ordered 
polynomial each monomial of which contains Xa and X,; at most once. If 
we replace Xy by x; and T by t, the three operations reduce to modifying 
expressions of the element of K[z,t]. Thus every element of K[x,t] can be 
written in the way stated before. We shall prove its uniqueness. Suppose 
that we have a relation of the form 


Po (ay) + Pa(ay)t+- ~~ + Pa (Ty) t= 0 


in which P,(2,,) ¢* is a linear combination of the said monomials for 0 & e & n. 
Also the relation is homogeneous in ay and t. We can assume that Py(2y) is 
different from zero. Let (T, £2, £3) and (Yı, Y2, Ya) be two independent generic 
points over K of a quadratic cone defined by X? + X,?+ X, = 0. Then 
(zy, t) > (29,0) is a specialization over K, hence P,(ay,;) =0. We shall 
show that this implies Po (£y) —0. We know that P,(X,,) is a linear com- 
bination of Xan’ : "Xu, with coefficients cy say. If we introduce three more 
letters Yı, Ya, Ya, the condition P,(z4;) =0 means that 


PL CD CR ARE 4 
is contained in the ideal of K[X., Xa, Xs, Ya, Y2, Yo] generated by 
Xe +HZ +X: and Y?+Y2+Y72. 


On the other hand, neither X, nor Y, appears twice in the products 
X t X4¥;,° Fa Since such monomials are linearly independent over 
K modulo the ideal in question, we get cy —0 and P, (a) =0. But this is a 
contradiction. This completes the proof of the key point. 

Now, for the proof of the normality of K[z,t], we can assume that K 
is algebraically closed or at least contains the primitive fourth root of unity 4. 
Then there exists an automorphism of K[z,t] over K permuting any zy with 
t (multiplied by a fourth root of unity). In fact, since the permutation of 
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any two lines or columns of the 3X 3 matrix (zy) followed by the change 
of signs of any line or column gives rise to an automorphism of Kfz, t] 
over K, we have only to show that 2,5, for instance, and —¢ are interchange- 
. able. This we see by verifying that > — zı, and 


Ti Tiz Tig Way itis — 
Tz Tea Tzs | —> | — Tes Ler ee) 
(= Taz =| | T22 — Tan 4233 

give rise to an automorphism of K[z,t] over K. (The meaning of this 
automorphism will become clear in the next section.) This being remarked, 
we consider (z,t) as a homogeneous generic point over K of a variety embedded _ 
in a projective space. Then its affine open set t40 is the variety of the 
special orthogonal group, and it is non-singular. Therefore, by the above 
remark, the projective variety is non-singular. The rest of the proof is 
similar to our proof of the artihmetic normality of the Grassmann variety [4]. 
We observe that the conductor of K[z,t] is irrelevant in the sense it contains 
a power of the maximal ideal of K[z,¢] generated by q and t. Consequently, 
the graded ring K|z, t] and its normalization coincide except for homogeneous 
parts of lower degrees. Suppose that they coincide at degree n but not at 
degree n—1. Let é be an element of degree n— 1 in the normalization which 
is not contained in K[a,t]. Then té is in K[s,t],, hence we have 


té = Po (24) + Pi(ay)t+ + Paty) 


in which P,(zy)t° is a linear combination of the previously explained mono- 
mials (of degree n) for OSen. Since ¢ is not contained in K[z,t], 
we have P,(z,) 740. Apply the specialization (ty, t) > (ayy,0) over K as 
before. Then, since é is integral over K[z, t], we have té— 0, hence P,(ay;) 
==0 and P,(z,4) —0. But this is a contradiction. q.e.d. 


Leama 2. Let R be a (noetherian) normal domain in which 2 is a unit 
and let a,,Q2,' ` +, a, be non-units of R such that Ra, + Ra, has rank two for 
izj. Suppose further that the quotient ring R/Ra; has no nilpotent element. 
Let b; be a square root of a for i=m1,2,:--,n. Then R[by, ba: - +, by] ts 
anormal domain. 


Proof. Put R, = R[b,]. If we can show that R, and a,- > ‚a, satisfy 
similar conditions as R and 4,4," ` `,G, we can apply an induction on n. 
Let K be the field of fractions of R. Then K(b,) is clearly a quadratic 
extension of K and R, is the normalization of Æ in K(b,). Moreover 2 is a 
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unit and as,’ - ,@, are non-units of R,. The “going-down” theorem of 
Cohen-Seidenberg [cf. 8, pp. 31-82] asserts that Ru; + Ra; has rank 
two for 1347. We shall show that R,/Rıa, has no nilpotent element for 
i==2,---,n. Otherwise there exists an element c of R, which itself is not 
but its square is contained in R,a, say. Write c in the form p + gb, with p, q 
in R. Then we have c?==( p? -+ g?a,) + 2pqbi = (p + qbi)a, with some 7’, 
g in R. This implies p? + g?a, == p'az, 2pq = g'az, hence p° -+ q’a, and 2pq 
are in Ras Since Ra, is an intersection of prime ideals not containing a, 
this implies that p and q are in Ras, hence c is in Rıa,. But this is a contra- 
diction. The lemma is thus proved. 


Lemma 3. Let K, ty, t be as in Lemma 1 and let (zy)?, ii be square 
roots of ty, t for 1Si, 738. Then Kit, #] is a normal domain. 


Proof. We shall show that the ten principal ideals K[a, t]zy, K[a, t]t 
are prime and distinct. First of all, a part of the proof of Lemma 1 shows 
that K[z,¢]t is the kernel of the homomorphism of K[a,¢] associated with 
the specialization (zig, t) — (2,0) over K. Therefore K[{a,t]t is a prime - 
ideal. Since we know that any ay is interchangeable with ¢ (multiplied by a 
fourth root of unity), we see that K[z, t]zųy is a prime ideal also. Since 
under the specialization (ay, t) > (24,0) over K, no zy is specialized to zero, 
the prime ideal K[a,¢]é is different from any other prime ideal K{z, t]zy. 
Therefore, no two of the ten prime ideals are same. The rest follows from 
Lemma 2 by taking K[z,¢] as R and the ten elements ay, t a8 0,0, ° * *, Oy. 

Now the preparation is made to prove the following theorem: 


THEOREM 1. The graded rings C[(6m)7], C[@m] and C[Omnbn] are all 
normal, hence A(T(4,8)) —=C[6mOn]. 


Proof. If we use Riemann’s theta-formula, which we explained in TC, 
Section 4, we can verify that 


t—— (0110)? 


Tir Tiz Tig (81001)? — (0,000)? (@s100)? 
% Von Leg | = 4(Oo001) d (Po000) a 4 (81100) 7) 
Tsi Ugg Vag (Ooo10)* — t (boon)? (1111)? 


define a zero of the ideal introduced in Lemma 1. Since the field C(6,,) has 
dimension four over C, we actually have a generic zero over C and the notation 
is justified. Therefore C[ (Am)?]=E[z,t] is normal by Lemma 1. Hence 
C[m] = C[ 4, #] is normal by Lemma 3. Since we have C[m$n} = C[9m]®, 
therefore C[6n] is also normal.. Then, TC, Theorem 5 implies that C[6m6n] 
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coincides with the ring of modular forms A(T(4,8)) belonging to the con- 
gruence group T(4,8). This completes the proof. 


2. Going-down process. Since we know the ring A (T (4, 8)), by taking 
invariant subrings successively, we can determine A(T(4)), A(T(R,4)), 
A(T(2)) and finally A(T(1)). This procedure is explained in TC, Section 
6. The ring A(T(4)) is generated over C by the ten (6m)2, fifteen products 
Omma Om Om, of distinct O's satisfying 


> Ma = I my =0 mod 2, 


fifteen “complementary ” products Om, Om, 9mm, Om bm, and by 
6 Soe II Om 


m even, mod 2 

The ring A(T (2, 4).) is generated over C by (mðn)? and 6, i.e. A(T (2,£)) 
=— C[z,t]©[0]. In particular, the modular variety proj. A(T(2,4)) is non- 
singular. The ring A(T(2)) is generated over C by the ten (6m)*, the fifteen pro- 
ducts (Im, OnOm,)*, the fifteen complementary products (Om, Om, Gari, Om bmd)? 
and by 6. If we cross out from these products (except 0) those which are not 
of the form Tup’ + Engt? where hS: SWwj>' 275, and in which 
Zu and Ta appear at most once, we get t, (212)?, (@1s)*, (222), (Les), CisTe2Teit 
and 6. Since we have — 


RT 13V22Tgb me (?— (212)? — (218)? — (232)? — (23,)?)* 
+ (T1228)? — (2isTa2)?, 
actually the element 7137237512 is redundant. Thus A(T(2)) is generated over 
C by 6 and by 
Your t, Yım (2), Ya (Taa)? 
Y= (Ta)? — Ë, Ya = (Ta)? — Ë. 


Furthermore these elements are related as follows 


(Yoyı + YoYs + Yıya — Yaya)” — 4YYY2 (Yo + Y1 + Y2 + Ys + Ye) — 0 
P= F: (Yoyı + Yoya + Yıya — YsY4) 
© (RYoYıya + YoyıYys + Yoyıya F Yoyays + YoYsys 
F RYoYsYat Yıyaya + Yıyaya + NYY + YYY 
H Yaya + Yayi). 


In particular the modular variety proj. A(T (2)) is a quartic hypersurface 
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(defined by the above equation) in the four dimensional projective space.” 
The going-down process from A(T(2)) to A(T(1)) is more involved. We 
have to know how T(1)/T(2) acts on A(T(2)) and, in particular, how the 
characters of its action on the homogeneous parts A(T(2))x decompose into 
simple characters for k = 0,1,2, ° -. 

We first observe that T(1)/T(2) =8p(2,2/2Z) is isomorphic to the 
symmetric group rs of permutations on six letters. The isomorphism can be 
given as follows. Suppose that M is an element of T(1) composed of a, b, c, 
d and m an arbitrary characteristic. Then M-m was defined as 


d —c cfd)» 
wm= 1) m+ on) 

If we consider characteristics mod 2, the group T(1)/T(2) operates on the 
set of odd (as well as even) characteristics. There are six odd characteristics 
mod? and they are (0101), (0111), (1010), (1011), (1101), (1110). Since 
the only element of Sp(2,2Z/2Z) keeping these characteristics fixed mod? is 
the identity, we have a monomorphism of 8p(2,Z/2Z) to mẹ. Since the orders 
of the two groups are same, we have an isomorphism. 

This being remarked, we shall determine the character of the represen- 
tation of Sp(2,Z/2Z) on A(T(2)),. We observe that we have 


dime A(r(2))x—(*/?;+ *) (97) 


— 1/12: (k? + 31 + 14k 412) 
for k= 0,2, 4, + and 


dime A (T (2) )x = dime A (T (2) )x-s 


for k =- 1,3,5,- +. In particular the dimensions are 1, 0, 5, 0, 15, lyre 
for k == 0, 1, 2, 3, 4, 5,° ++. We shall determine how Sp (2, Z/2Z) operates 
on A (T(2)): This can be done using TC, Theorem 6. We do it as follows. 
We call the six odd characteristics mod2 simply 1,2,---,6. We know in 
general that the symmetric group mg on g letters is generated by (12) and 
(12: - +g). The element M of T(1) which gives rise to (12) satisfies 


1 0 1 0 


M = mod 2. 


ooo 
oor 
oO 


1 


* If 8 is a graded integral domain (of finite type over C), we have proj. 8 =proj. 8 
for every positive integer d. We are using this fact for d= 2 in the above two cases. 
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Also the element M of T(1) which gives rise to (123456) satisfies 


0101 
1010 

Me 10141 mod 2. 
—1 101 


We shall denote the elements of T(1) standing on the right sides by My, and 
M,..., respectively. We-have seen in TC, Section 2 that the transformation 
law of theta-functions implies 


bu-m( M:r) == 2(M)6(dm() ) det (cr + d)#0n (7) 
for all M in T(1) in which 
dm (M) = — 4: (tm’tbdm’ + tm”tacm” — %*m’!bem’” 
— t (atb) (dm — cem”) ). 
` We can determine #(M,,) and #(M,...,) as in TC, Section 3. In particular 


we have 
e(My)t—=1,  @(My..)?=6(4). 


Now, in order to obtain a concrete matricial representation of Sp(2,Z/22Z) 
acting on the five dimensional complex vector space A(I'(2))s, we arrange 
Yo. Yu’ ` *,¥4 in a column vector y. Applying the formula we just copied 
from TC, we then get 


M*-y—=p(M)y 
with 

: 0 1 0 0 0 1 0 0 1 0 
1 0 0 0 0 À 0 0 íi 1 0 
p(Mi) = 1 1 1 1 1], p(Mi-c)— | 0 1 0 1 0 
—1 —1 0 —1 0 000 —1 i 
—1 —1 0. 0 —1 000 —i 0 

We also have 


My, f 6 = M... gt i 6 =: — f}, 


We shall combine these results with the known theory of representations of 
symmetric groups [3,11]. 

We know in general that conjugacy classes of m, correspond to partitions 
of g. In fact every element of =, has a cycle expression and it determines a 
partition of g. Two elements of m, are conjugate if and only if they correspond 
to the same partition of g. On the other hand, simple characters of x, 
also correspond to partitions of g. In fact each partition of g determines a 
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primitive idempotent of the group ring of mg over Q and it gives a simple 
character of z, and conversely. Now the number 6 has the following eleven 
partitions 

51-4434 +1 +15 48-342 +1 

= +1 +1 +1=2 422 EI EI Er 

III FTSE ee IT 


We arrange eleven conjugacy classes and simple characters of re in this order 
(one from top to bottom another from left to right) and write them as 
follows: 


1-1 0 1 0 0 —1 0 0 1 —1 | 120 
1 0 —1 0 0 1 0 0 —ı 0 1 | 144 
1-1 1 0 —ı 0 0 —i 1 —i 1 90 
1 1 —1 0 —i 0 0 1 1 —1 —ı 90 
1 —1 0 1 2 —2 1 2 0 —ı 1 40 
1 0 0 —i T 0 1 —l1 0 0 —ı | 120 
1 2 0 1 —1 —2 1 —i 0 2 1 40 
1 —1 3 —2 —3 0 2 3 —3 1 —1 15 
1 1 1 —2 1 0 —2 1 1 1 1 45 
1 3 3 2 1 0 —2 —1 —3 —3 —i 15 
1 5 9 10 56 16 10 5 9 5 1. 


The last column which is separated from the main part indicates the numbers 
of elements in the conjugacy classes. 

The table shows that the representation p is irreducible and its character 
is the character xaz, corresponding to the partition 6=2--2?--2. Using 
the representation p, we operate Sp(2,Z/2Z) on the graded ring C[Y] of 
polynomials in five letters Yo, Y:,- © +, Ya each of degree two with coefficients - 
in C. If we denote by % the character of the representation on C[¥],, for 
every M in Sp(2,Z/2Z), we have the following identity 


È Vox (M) & == 1/det (1; —p(M)t) 
pn a] 


of formal power-series in t. We then observe that A(T(2))® is the quotient 
ring of C[Y] by a principal ideal generated by 


(YY + YY: + FY: — YY.) — 4Y YY (Fr HF, +: x “+ ¥,). 
This polynomial (in fact both 
YY + Yo¥2 + Y Y: Vf: and YYY. (Yo +F, +: . -+Y7,)) 
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are invariant by the operations of Sp(2,Z/2Z). Therefore, if X, is the 
character of the action of Sp(2,Z/2Z) on A(T(2))x, we have 


S te (1-2) E Pat. 
oco okce 


Moreover, if k is odd, we have A (T (2))s =A (T (2))z-s'0 and the element 6 
has the property M-9—=«(M)$, in which e( M) == = 1 according as M corres- 
ponds to even or odd permutation of mẹ. We note that e is the simple character 
corresponding to the partition 6=1-H1+1+1+1-+1. In this way, we 
get the following definitive result: 


THEOREM 2. The characters X, of the representations of Sp(2,2/2Z) 
on A(T(2))x are given by 


D X,(M)i = (1+ (Mt) (1— 4) /det (1, p(M)#). 
Osho 


A complete table of det(1,;—p(df)t) can be obtained very easily and 
it is as follows: 


G= HI) HE+) (123456) 


1— t (12345) 
(1—#) (14+ 4)°(1 4+ 8) (1234) (56) 
(1—#)9(1 4 4) (1-+#) (1234) 
(1—~t)8(1+¢+#) (123) (456) 
(14-4)(1—#+ 4) (14444) (123) (45) 
(1—#)(1-Lé+ 0) (128) 
(1—#)4(1 +t) (12) (84) (56) 
(1—#)9(14-4)? (12) (34) 
(1—~#)9(1 4 4)" (12) 

(1—2#)* (1). 


The symbols standing on the right are representatives of conjugacy classes 
and the ordering is the same as before. We note that this table can be 
obtained knowing only that we have trace(p) = x22. and knowing the values 
of X222* 


3. Going-down process (continued). We recall that, if G is an arbi- 
trary finite group and X a character of @, the multiplicity mx of a simple 
character x in X can be determined as 


mx = 1/ord(G@) ECs) xs). 
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Also, if G is a symmetric group, we have x(s*) =x(s) for every s. Using 
the results in the previous section, therefore, we can decompose the character 
Xx into simple characters. In particular dime A(T(1))» can be calculated as 
the multiplicity of the principal character in X, and we get 


web, dime d (T(1) Ja 
= (1-+ 2) /(1—#) (1—#) (1—#) (1— t) 
1p H+ Efe RPO BHF - 


The calculation (which we are not writing down here) shows also that, if we 
denote by T(1), the subgroup of I'(1) of index two defined by e(M) —1, 
we get - 


S dime A (T(t 
oko 
= (14) (1—#) (18) (1-29). 


At any rate, since we know 


a RATTE) 
J mHE HEHEHEH, 


the ring A(T(1)) is generated over C by two modular forms of weights four, 
six and three cusp forms of weights ten, twelve, thirty-five and all are unique 
up to constant factors. We also remarked previously [5, Appendix] that the 
definition and elementary properties of Eisenstein series plus this information 
imply that, if we denote.by y the Eisenstein series of weights k for k= 4, 
6,: ++, the modular forms of weights four, six are constant multiples of y4, 
we and the cusp forms of weights ten and twelve are constant multiples of 
babe — yio and 3272 (1)? + 2-53 (ve)? —691ys2. We shall construct these 
modular forms explicitly using theta-constants. 

We shall denote (9m)* corresponding to ten even characteristics mod 2 in 
the order of Section 1 by (1), (2),---, (10). Then a general observation 
in TC, Appendix shows that 

£ OS =e Led) 
ısizıo i<j 
is an element of A(T(1)), which is mapped to 1 by the square of the Siegel 
operator. Hence this is y4 In order to obtain the element of degree six, 
we apply a similar method, i.e. the symmetrization of products of theta- 
constants. We observe that the symmetrization of (1)® and (1)?(2) are both 
zero. Therefore we shall consider the symmetrization of (1)(2)(3). We 
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observe that T(1) does not operate transitively on the set of all triples of 
even characteristics (mod2). In fact 


e(i, j, k) = e(t,j)e(j, k)e(k,t) 


is invariant under the operations of T(1), and it is 1 for (1,2,3) and is — 1 
for (1,2,5). They are known as “syzygous” and “azygous” triples. At any 
rate, we can verify that T(1),, hence a fortiori (1), operates transitively on 
‘the sets of syzygous and azygous triples of even characteristics. We there- 
fore apply symmetrizations with respect to T(1). to (a) (2) (3))™ and to 
((1) (2) (5))™, in general, and put 


(8723) m = 3 2. (= (+) (7) (œ) )” 
(22y)m =$ en (= (+) (7) (k))™ 


for m—1,2,3,---+. The summation in (syzy):, for instance, is extended 
over sixty syzygous triples of which thirty have plus-sign and the remaining 
thirty have minus-sign. The summation in (azy), is similar. We observe that 
(syzy)m for every m and (azy)m for even m are elements of A(T'(1))om while 
(azy)m for odd m belongs to A(T(1).)om and not to A (T(1)) unless it is zero. 
Furthermore the square of the Siegel operator maps (syzy)m to 1, hence 
(syzy)ı is just a different expression for ys As for the cusp form of weight 
ten, we have one such form, i.e. 6%. Moreover the Fourier expansion of 0 
itself starts as follows 


6 (" j ) = — 2'i- e(wı/2)e(wi/2) (me) +°>. 


€ Wa 


There is no ready-made cusp form of weight twelve. We therefore symmetrize 
(1)° and try to determine a linear combination of the symmetrized element 
and (#4)°, (Ya)? to get a cusp form. In the calculation, it is understood that 
we use the expressions of ya, Ye by theta-constants. This simple consideration 
works and we get a cusp form together with the following Fourier expansion 


(FE rue (Mf) 


ists We 
== 275341 1e(w,)e(we) +---. 


Finally we shall obtain the cusp form of weight thirty-five. The formule for 
dime A(T(1).)» shows that it is a product of @ and an element of A(T(1).)so 
not in A(T{1)). We just have one such element, i.e. (azy), provided it is 
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different from zero. We can verify easily that (azy) are different from zero 
except form == 1,3. Furthermore (azy), has the following Fourier expansion 


(azy) ("7 j ) = 28e (8w,/2)e (303/2) (ews) — (m) ren 


Wa 
We shall summarize our results in the following way: 


TruormM 3. The graded ring A(T(1)) is generated by Wu, Yo and three 
cusp forms Xıo, X12) xas Of weights ten, twelve, thirty-five with Fourier ezpan- 
sions of the form 


A g SECOLE 26 


€ wW. 


Xss © == e(2w,)e(2w;)(e(wı) —e(ws)) (m) ++. 


€ 


They are all expressed by theta-constants. Moreover the ideal of cusp forms 
is generated in A(T{1)) by x10) Xis Xss 


Only the last statement needs a proof and it is as follows. Let J be the 
ideal of A(T(1)) generated by x10, x12) xas- Since a cusp form of odd weight 
is in A(T(1))xas, it is in J. Therefore we have only to show that cusp 
forms of even weights can be written in the form yxıo—Yxıa with y, y” in 
A(T(1))®. Since A(T(1))® is just a ring of polynomials in the four 
independent variables Y4, We, x10) X12 Over C, we have yyio— Wis = 0 if and 
only if p= yw, Y =Y xo With y” in A(T(1))®. Therefore, for every 
even positive integer k, the dimension of (A(T(1))/J)x is given by 


coeta ((1— — t 4- t) /(1 — #4) (14) (1—1) (1B) 
= coeff (1/(1— t) (1— t°) ), 


and this is the dimension of (A(T,(1))x. Hence J, is precisely the kernel of 
the Siegel operator A(T(1))&—4A(Tı(1))., and the theorem is proved. 

We note that (xss)? is in A(T(1))®, hence it is a polynomial in ys, Ye, X10 
X12 With coefficients in C. This modular form is connected with the “skew- 
invariant” of binary sextics [cf. 5]. Also we make the following statement: 


COROLLARY. The graded ring A(T(1),) is generated by Ya, Ys and the 
~ three cusp forms 6, xıs, (azy)s of weights five, twelve, thirty. 


Finally, we shall consider the ring of modular forms A(T(1,2)). Since 
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T(1,2) is the stabilizer of (1) = (Ooo00)*, it is a subgroup of T(1) of index 
ten. Moreover the image of T(1,2) in r, can be determined. It is the sub- 
group of ma generated by permutations of 1, 4, 6 (among themselves ), permu- 
tations of 2, 3, 5 and by (12)(34)(56). In particular, the numbers of 
elements in the image corresponding to various partitions of 6 in the previous 
section are in that order 12, 0, 18, 0, 4, 12, 4, 6, 9, 6,1. Using this fact and 
the results of the previous section, we get 


vee dime A(T(1,2)).& 
u = P(t)/(1—#) (1— #) (1-4) (18°) 
== 1 + Qt + Rte + + 572° +4. 9447 +-- 2% 

in which P(t) == (1— t + t 4 t) -+t (1 4t — t+ t). In particular 
the dimension of A(T(1,2)), is two. We know two linearly independent 
elements of A(T(1,2)), already, and they are (1)?— (oo00)® and ya. On 
the other hand, if we denote the Eisenstein series of weight four belonging to 
T(1,2) simply by y’, this is also an element of A(I'(1,2)),. Hence we get a 
relation of the form 


Ya’ = p(Bo000)*® + qha 


with some p, q in C. If we symmetrize this relation with respect to T(1), 
we get 4p + 10qg==4. On the other hand, if we apply the square of the Siegel 
operator to the above relation, we get p + q=1. The two equations have a 
unique solution (p,q) = (1,0): Going back to the definitions of y,’ and 
sooo, We therefore get the Braun identity 


„Zee d) = (Zeh pre)" 


We can give a more systematic treatment using Fourier expansions of Eisen- 
stein series and also we can discuss relations of Hisenstein series of higher 
weights. 


4. Singularities of modular varieties. We recall that, if T is a sub- 
group of Sp(2,R) containing T(2,4) as a subgroup of finite index, the 
corresponding modular variety proj. A (T) has proj. A (T (2,4)) as a (global) 
non-singular covering. Therefore, the singularities of proj. A(T), in par- 
ticular those of proj. A(T(1)) and of proj. A(T(2)), are not too bad. We 
shall show, however, that the singularities of proj. A(T(n)) are quite bad for 
n= 3. Let o be the 0-dimensional boundary component of © defined by 


co == Jim inle. 
m> 
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The values of 6, at œ, which are the images of 6, by the square of the Siegel 
operator, are simply 1 for m = (00) and zero otherwise. At any rate, the 
point oo has a unique iniage point in every modular variety. 

THEOREM 4. There is no regular local ring which is integral over the 
analytic local ring of the modular variety proj. A(T(4)) at the image point 
of œ. . 

Before we start proving this theorem, we recall the footnote 2 saying in 
particular that, in the consideration of modular varieties we can restrict 
modular forms to those of even weights. Therefore we shall talk about rings 
of modular forms without adding the superscript (2). We need some lemmas. 


Lemma 4. If we put 


U1 = (Boroo/Boooo) *, Uz = (Oro00/ 00000) 
Us = (B1100/ 0000) A 
these three functions form a set of local parameters of proj. A (T (2,4) ) at the 
image point of œ. i 
Proof. We shall use the well-known Jacobian criterion. If we put 
Yoo == t/Tz3 and Yy = y/Ts for (ij) different from (12), (13), (22), (23), . 
the nine functions ui, Ue, us, Yiz satisfy the following six identities 


(Yan)? + 1— (us)? — (Yoo)? = 0 
Yas Y21 — Mg + ys = 0 
(Ya)? + (Yar)? + (Yar)? — (Yoo)? = 0 
— (u2)? + 1+ (Ys2)? — (Yoo)? = 0 
— Wy tl T ius + Yazyız — 0 
= WusYas — Ua + Yooyaı = 0. 
If we evaluate the Jacobian of this system with respect to the six yy at the 
image point of ©, we get 
E 2° (Yar) Yar (Yo) (00) = + 25, 
and this is different from zero. Therefore 1, Us, us form a set of local 
parameters of proj. A(T(2,4)) at the image point of œ. 


Actually the same proof shows that the three functions in the lemma 
form a set of local co-ordinates of proj. A (T (2,4) ) at the image point of 


(s 2) 
re 0 in 
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for every w in the upper-half plane. In fact, the Jacobian in question will 
just become + 2% (du. (w)/boo (w) )*. 


Lemma 5. Let R be a (noetherian) normal domain and ay, aa, > `, üa 
be elements of R such that Ra,+ Ra, has rank two for ij. Let b bea 
square root of the product a,a,°- "a, and let S be a unique factorization 
domain which is integral over R[b] and in which every unit has a square 
root. Then S contains the square roots of a4, as, > *,Qn. 


Proof. Suppose that a square root b, of a, say, is not contained in 8. 
Then in the decomposition of a, into irreducible elements in S, at least one 
of them, say P, appears odd times. Since the product a.a,: ` "a, is a square 
in S, another element, say a,, also contains P odd times. Now the intersection 
p of PS with R is a prime ideal of R, and it contains both a, and as. There- 
fore p contains a minimal prime ideal q of a,, and q is strictly smaller than 
p by assumption. Hence the going-down theorem of Cohen-Seidenberg asserts 
that PS contains a prime ideal having q as its intersection with R. But PS 
has rank one, and this is a contradiction. 

Now, we shall start proving the theorem. We note that proj. A(T(4)) 
is an abelian covering of proj. A(T(2,4)) with the Galois group isomorphic 
to T(2,4)/T (4) (+ 14). Since this is a vector space over Z/2Z of dimension 
five, we need five independent radicals, and the following elements of A(T(4)) 


00009000190010900115 900009 c010F010090110 
90000900019300081001, 9o000900119110063111 
Po000801 009100092100 


divided by (@oooo)* are such radicals (as we see by TC, Theorem 8). We 
cail them in this order 2,22,---,2;. Then, up to units in the local ring 
of proj. A(T(2,4)) at the image point of œ, we have 


()—L — (24)? ~ u (Us — th) 

(BU (Usti — Us), (24)? ~ ts (Urtia — Us) 

(T5)? ~ Us. 
Suppose therefore that a regular local ring $ is integral over the analytic 
local ring of proj. A(T(4)) at the image point of œ. Then 8 is isomorphic 
to a ring of convergent power-series in three variables over C. In particular, 
it is a unique factorization domain in which every unit has a square root. 
Moreover Lemma 4 shows that the analytic local ring of proj. A(T(2,4)) 
at the image point of œ is the ring of convergent power-series in th, Ua, tbs 


11 
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with coefficients in C. Therefore we can apply Lemma 5 taking this regular 
local ring as R. We see, in this way, that S contains the square roots of u, 
Un, Up, Ude — Ur, Ugly — U, Uruz —tus Namely, if we denote the square 
roots of 1, Ua, Ug by v4, Va, vs, the ring J contains not only vı, ve, vs but also 
the square roots of (v1)?— (vsvs)*, (v2)?— (vs01)?, (vs)?— (v102)?. We 
apply Lemma 5 again to the same 8 and to the ring of convergent power-series 
in 11, Va Vs With coefficients in C, and we see that 


(v, = vava )4, (v2 + vav) 5, (vs + vv)? 
are all contained in §. We shall show that, if we put 


ty’ = 2 (0; + vgs) / (1+ uy, + Ue + ts) 
ug = 2 (v: + 0301) /(1 + uy + Ua + tia) 
tha’ = 2 (Va + Vwa) / (1 F ta + Ua + tts) 


and define vı’, 04’, vs’, Ui’, U2”, Us”, 01’, ve", V”, - - similarly, these two 
sequences are both contained in 8. 
We recall that, in TC, Section 4, we proved the following identity 


Im E (—1)'™" ("3") (7) 9(%) (7). 


In fact this was obtained by putting z=0 in the “second principal trans- 
formation” of degree two. At any rate, written explicitly, we have the 
following ten identities: 


bovo (7/2)? = Boooo (7)? + Gox00 (r)? + 1000 (r)? + 81100 (r)? 
Ooooı (7/2) 2 9000 (r) 7 boroo (7)? + 1000 (r) 2 — 91100 (r) 
ooro (7/2) ® — Bo000 (7) 2 + Bo100 (r)? — r000 (7) 2 — 93100 (7)? 
Go011 (7/2) 2 oo00 (7) 2 — Ooıoo (r)? be P1000 (r) - + 93100 (r) 3 
Oo100 (7/2) 2—2 (Boooo@oı0o + 9100092100) (r) 
forio (7/2) 2 = 2 (Aooo0o100 — 9100091100) (r) 
61000 (7/2) 2—2 (8000081000 + 8010091100) (r) 
O1001 (1/2 ) 3—2 (900009000 rot 8010091100) (r) 
91300 (7/ 2) 3—2 (8000092100 + 8010091000) (r ) 
bun (1/2) 2—2 (Go00001100 ar 8010091000) (r) . 


Therefore, if we recall that we have 


Vi = Bo100/ 00000; V: = Or000/ o000, Va = Ox100/ Booo0, 
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the ten functions r—6m(r/2)/Boooo(r) are all contained in S. Since 
7 Booa(r/R)/oooo(r) is one of the four units among them, the modified 
functions r— (@m/80000) (7/2) are also contained in S. We now observe that 
OUT ty’ ,tiy’, Us’ and Uz, Uo, U, are related simply as 


tf (7) = (7/2) 


for i=—= 1,2,3. It is thus clear that the entire argument can be repeated 
starting from tu’, us’, us’ instead of 14, Uz, ts. In fact, we have only to replace 
t by 7/2. Therefore, by an induction on n we see that the two sequences u), 
0) defined in an obvious way for n = 1,2,- - - are contained in 8. However, 
since we have the following relation 


“y= (un) 2" 722G*-2) + wee 


for n=m1,2,-- +, we see that th, Uz, us are contained in the intersection of 
powers of the ideal of non-units of 8. Hence we get u, == u: = ts = 0, but 
this is a contradiction. Theorem 4 is thus proved. 

It is not without some interest to see how the iteration process looks like 
in the elliptic case. Clearly we have to take u == (610/8o0)*, V = 910/800. AB 
for w defined by w’(w) ==u(w/2), the formula we copied from TC tells 
that we have 

w == 20/(1-++ 4). 


This is the quotient of the geometric mean of 1, u by their arithmetic mean. 
In other words, the process is the one which is familiar in the Gauss theory 
of “arithmetic-geometric means.” 

Also it is of some interest to extract a purely algebraic statement from 
the above proof: 


COROLLARY 1. Let K be an algebraically closed field of characteristic 
different from 2 and let R be a local ring which is integral over the ring of 
formal power-series in three variables u,, Us, Us over K and which contains a 
square root of the product Urtats (tt, — Ust) (Ug —tlgth,) (us — tta). Then 
there is no regular local ring S which is integral over R. 


In fact $ is isomorphic to a ring of formal power-series in three variables 
over K and, by Lemma 5, it will contain the square roots 4, Va, Vs Of th, Ur, Us 
and (V, 4203)8, (V2 + v301)4, (Va = 0,02)4. We define u’, Uy, u,’ as before. 
If we can show that S contains the square root of the product 


thy!Ug/thg! ( u,’ — ugus’) ( ts! = Uu’) ( uz Er Uy! te! ) ; 
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the same induction as before can be applied. Clearly $ contains the square 
roots of w’, ty’, us’. By the obvious symmetry, we have only to show that 8 
contains the square roots of u’ — u‘. This is a consequence of the 
following relation 


ty! — thy’ ty! = 2 (4, — 0205) (1 + ta — Ur — ta) 
“(14th ++ us + Us)”, 


which can be verified easily. Incidentally, in the complex case (hence in 
general by the universality) this reflects the following relation of theta- 
constants 


(8010090110) (1/2) == 2 (Bo01090110) (r) ` 


We note also that, in case K has a valuation like C, we can talk about rings 
of convergent power-series instead of the rings of formal power-series, and 
get a similar result. This result can be used as a lemma (rather than a 
corollary) to prove Theorem 4 and, in this way, we can simplify the previous 
proof. 

We shall now derive a more general statement from Theorem 4. The 
group T is assumed, as always, to be commensurable with T(1): 


COROLLARY 2. If T has no element of finite order (other than + the 
identity), there ts no regular local ring which is integral over the analytic 
local ring of proj. A(T) at the image point of œ. 


We know that the intersection I’ of T and T(4) has finite indices in T 
and T(4). Therefore proj. A(T”) is a (finite) covering of both proj. A(T) 
and proj. A(T(4)). Suppose that there exists a regular local ring 9 which 
is integral over the analytic local ring R of proj. A(T) at the image point 
of œ. Let R’ be the analytic local ring of proj. A(T”) at the image point 
‚of œ. We shall denote by U, V, V’ the (irreducible) local analytic varieties 
associated with 8, R, W. Then U and V, V’ can be considered as “sheets” 
of C? at the origin and of proj. A (T), proj. A(T”) at the image points of oo. 
Also we have covering morphisms f: U —> V and f: V’’—>V. We shall show 
that there exists a covering morphism h: U->V’ satisfying [=f’h. Let 
Y, Y’ be the complements in V, V’ of the quotient varieties TVS, I’\S, and 
let X be the inverse image in U. Then X, Y, Y’ are analytic subsets of 
U, V, V’ of co-dimension two and f is “unramified” over V—Y. We take 
a point p of U not in X and pick a point g’ of V’ lying over f(p). Then g 
is not in Y’ and since U— X is simply connected, if we make an analytic 
continuation throughout U —X, the correspondence p— g’ defines a unique 
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(analytic) morphism of U—X to V’—-Y’. This morphism can be com- 
pleted to a morphism h of U to V’. Clearly h satisfies f == fh and it is a 
covering morphism. On the other hand, since proj. A(T”) is a covering of 
proj. A(T(4)), we see that S is integral over the analytic local ring of 
proj. A(T(4)) at the image point of œ. This contradicts Theorem 4. 

We note that the above proof can be made more formal using the “ purity 
of branch loci” due to Zariski and Nagata [cf. 8, pp. 158-68]. At any rate, 
since we know in general that T(n) has no element of finite order for n= 3, 
Corollary 2 can be applied to the analytic local rings of proj. A(T(n)) at the 
image points of © for n=3. In this way, Theorem 4 becomes a special 
case of the more general Corollary 2. 


5. Concluding remark. As before, let T be commensurable with T(1). 
We shall denote by v(T) the volume of the quotient variety TXS with respect 
to the invariant measure of the homogeneous space © == Sp(2,R)/U(2). 
We know that v(T) is finite [10]. Moreover, if T contains another I” as a 
subgroup of finite index, the quotient v(T’)/v(T) is equal to the index of 
I’(+1,) in T(+1,) and also to the degree of the covering proj. A(T”) 
—> proj. A (T). We normalize the constant factor in v(T) so that we get 


v(T(1)) = 1/28335. 
Actually, this “intrinsic volume” can be defined in general and in the elliptic 
case we have v(T(1)) 1/273. 


THEOREM 5. According as T may or does not contain elements of finite 
orders, we have 


dime A(T), =v (T) : (k—1) (k—2) ($ E— 4) +0 (r), 0(%). 


In the second case, it may be necessary that k tends to infinity as multiples 
of a certain integer. 


We shall not give a proof of this theorem but leave it as an exercise to 
the reader. The proof we have in mind depends on Leray’s spectral sequence, 
coherency of direct images of coherent sheaves and on the comparison of 
characteristic functions of coherent sheaves on a normal projective variety 
which coincide on some Zariski open set and finally on the following formula: 


9113-278 — 2103k? 1 283-16Yk — 2731 
1, 55, 695, 3969 


in which the first line is used for k= 4 and the second line is used for 


dime A (T (4, 8) )x = j 
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k= 0,1,2,3. This result itself can be derived easily from Theorem 1 using 
some part of the proof of Lemma 1. 


THE JOHNES HOPKINS UNIVERSITY. 
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FINITELY GENERATED KLEINIAN GROUPS.* 


By Lars V. AHLFORS. 


1. Introduction. 1.1. Let T bea group of linear transformations 


Ar zta ad—bc=1 

of the extended complex plane. A point z, is called a limit point of T if it 
is an accumulation point of points Az,, A € T, some some z,. The set of limit 
points will be denoted by Z(T), or by & when it is clear to what group we 
are referring. 

X(T) is a closed set, and invariant under I'; we denote its complement 
by Q=Q(T). As soon as Q(T) is not empty we say that T is discontinuous, 
and Q(T) is its set of discontinuity. It is easy to classify all groups for which 
% is void, consists of a single point, or of two points. All other discontinuous 
groups will be called Kleinian groups. In other words, a Kleinian group is a 
discontinuous group with more than two limit points. In this paper T will 
always denote a Kleinian group. 

For Kleinian groups the images Az,, A ET, of any point z, accumulate 
toward all of 2. It is an immediate consequence that % is a nowhere dense 
perfect set, and that every nonvoid closed invariant set includes 2. 

A Kleinian group which leaves a circle invariant is said to be Fuchsian. 
The set of limit points lies on the invariant circle. If 3 is the whole circle 
the Fuchsian group is of the first kind. If not, X is nowhere dense on the 
invariant circle, and the group is of the second kind. 

The fixpoints of non-elliptic transformations in T lie on %. There are 
always infinitely many hyperbolic or loxodromic transformations, and their 
. fixpoints are dense on 3. The fixpoints in Q belong to elliptic transformations, 
and they are isolated. 


1.2. In order to study the action of T on Q we consider the quotient 
space S = Q/T. It has a natural complex structure such that the projection 
map x: Q->8 is holomorphic. Thus, the components 8, of S are Riemann 
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surfaces. We shall write Q;—-77S, In general, the Q; are not connected, 
and we denote the components of % by Qy. 

With any Kleinian group T we have thus associated the decompositions 
O=U%—UOy and S=US, Each Q, is invariant under the full group 
T, and the boundary of œ% is all of & The components Qy are ramified 
covering surfaces of 8; whose branch points are elliptic fixpoints. 

The projections of the branch points will be denoted by p. They are 
isolated, and with each ps there is associated an integer my = 2, the order of 
the corresponding elliptic transformation. We say that S has a signature 
I == {pr mx}. S together with its signature is denoted by S(I), and 8;(7) 
has a similar meaning. 

We shall say that $ is of finite type if there are finitely many com- 
ponents S; and points p, and if each 8, can be obtained from a compact 
surface by omission of a finite number of points. When this is so it is con- 
venient to let $, denote the compact surface, and to regard the omitted points 
as points 7, with m,—oo. It will be clear from the context when 9; should 
be interpreted in this manner. 


1.3. The main result to be proved in this article is the following 
statement : 


If T is finitely generated, then S is of finite type. 


This is known for Fuchsian groups, but to the author’s knowledge there 
is no proof in the published literature. A proof is contained in a manuscript 
of Nielsen and Fenchel, where the résult is obtained at the end of a pene- 
trating study of Fuchsian groups. Recently, L. Bers has found a short proof 
by variational methods, the same that have proved so useful in the theory of 
Teichmiiller spaces.* 

My task has been to show that Bers’ method can be extended to arbitrary 
Kleinian groups. The main difficulty was the correct formulation and proof 
of a crucial lemma, which is to be considered the core of this paper. We have 
formulated it in two parts, as Lemma 8 and Lemma 9. l : 

In the last section we prove some results on functions groups, that is, 
groups with an invariant region. These were the results that gave the initial 
impetus to this study. 


1.4. Perhaps of greater interest are the theorems I have not been able 
to prove. For instance, it seems very likely that the set 3 for any finitely 
generated group T has zero area, but I cannot prove it. l 


+ Unpublished. 
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. Any Kleinien group can be extended to a corresponding group of Möbius 
transformations in the Poincaré half-space. If I is finitely generated it seems 
plausible that the Poincaré group has a fundamental polyhedron with only 
a finite number of vertices on %. Again, I cannot prove this, but if this is 
so I am able to show that % has indeed zero measure. 


2. The Poincaré metric. 2.1. Each component Ry carries a Poincaré 
‘metric ds = p | dz | with constant negative curvature equal to — 1, and such 
that Qy is complete in this metric. The metric is unique, and therefore 
(2.1) p(4z)| 4’(s)| —p(2) 
for all AET which map Oy onto itself. We shall consider p on all of Q, 
defined in each y. Then (2.1) holds for all A €r. 
The projection + induces a corresponding metric p|dg| on 8. Here £ 
is a local parameter on S, and p is determined by ș | dł |==p|dz|. At the 


branch points d{/dz—0, and we see that 5 becomes infinite at the points pr. 
If 8, is compact the Gauss-Bonnet formula yields 


1 
2.2 EEE eee E a 
(2.2) x) + Z UE) = E fop dos 


where x(8:) is the Euler characteristic. The formula remains valid for any 
8,(I) of finite type, provided that x(8;) is the characteristic of the compact 
surface and the infinite signatures are included in the sum. To prove (2.2) 
for this case requires knowledge of the asymptotic behavior of p at the punc- 
tures. If the omitted point corresponds to £==0 this behavior is given by 


(2.8) log p= —log | ¢ | —loglog (1/| £|) +0(1), 
a classical result. 
An immediate consequence of (2.2) is that 


(2.4) DES EN 
PES; Me 


This rules out certain possibilities. Without insisting on the details, we 
conclude that 9; cannot be a sphere with certain low signatures, nor can it 
be a torus without signature. 

A more careful analysis of the possible cases shows that (2.4) can be - 
sharpened to 


x(8) +X 0—4) 21/42. 
S; Myg 


This is important becaure it shows that S 4s of finite type if and only if its 
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total Poincaré area ts finite. The conclusion uses the elementary fact that a 
single surface with finite Poincaré area is necessarily of finite type. 


2.2. We show next that the points pẹ with m,=—=0o correspond to 
parabolic fixpoints. Since the result does not require 8 to be of finite type, 
let us merely assume that S,—-9,—{p.} where 8; is a Riemann surface 
and Pr € By 


Lumma 1. There exists a parabolic transformation AET with the 
following property: If the linear transformation U is such that U*A,Us 
=2-+1, then Q; contains a set {z | Im Uz > c} and x(z) > py when zE 
approaches the fixpoint u —=Umw in such a way that Im Uz>w. 


We remark that A, can of course be replaced by any conjugate trans- 
formation B4B with BET, in which case 2, is replaced by Bz,. The 
set {z | Im Uz > 0} is a disk or a halfplane whose boundary passes through zx. 
It follows that there are at most two pẹ which correspond to the same 2x. 

For the proof of the lemma we may regard pẹ as the center of a punc- 
tured disk A C Sẹ represented by 0< |€| <1, and we may assume that no 
point in A has a signature. Let A be a component of (A). It is clear 
that the cover transformations of A over A are generated by a single trans- 
formation AET which is not elliptic. 

If A is hyperbolic or loxodromic we can take it to be of the form 
Arkz, | |541. In terms of s==log{ the projection m induces a one-one 
correspondence 2==2(s) between the halfplane Res < 0 and A which satisfies 
z(8 + 2ri) =kz(s). Because 0 is a limit point it is not in A, and therefore 
the distance from 2(s) to the boundary of A is at least |a(s)|. With this 
information Koebe’s one-quarter theorem easily yields 


|#(8)|/|2(8)|S2/| Res |. 
Integration from s to s+ 2r along a vertical line gives 
| log | $] | S4z/| Bes |. 


But this is absurd, for | Res| can be chosen arbitrarily large. 
We conclude that A is parabolic, for instance Az=2-1. In this case 
2(s- 2m) ==2(s) +1 and it is elementary to deduce that 


exp (di) =t +a Hayt +: +, 
from which 


(2.5) 2(8) 5°; +02) 


and, for later use, 
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(2.6) dz/dt = (Ami) +4+-0(|£|-*). 


It is immediate from (2.5) that Q, contains a halfplane y>c, and that 
y—>co implies #(2)—> pi. This is the assertion of the lemma when U is the 
identity, and the general case follows by application to the group U“TU. 


2.3. We shall use (2.6) to derive the asymptotic behavior of p in 
terms of the uniformizer £ Because p|dz|=—,|d£| we obtain, with the 
help of (2.3), 

(2.7) log p——log log (1/|£|) +0(1). 
In the derivation of this formula we have assumed that U is the identity, but 
it is easy to see that it remains valid as soon as the fixpoint is at œ. 

In case of a finite fixpoint we make the transformation z=Uw. The 
Poincaré metric in U-'Q is given by po(w)|dw|—p(z)|dz|. It is for po 
that (2.7) is valid, while (2.5) is applicable to w in the place of z. We have 
log p — log pop —log | U” (w) | log po + 2log| w| +O(1),for since Vo is 
finite, w®U’(w) has a finite limit when w—>oo. It follows that 


log p= — log log(1/| €|) + 2log|log¢| +01). 
The expression on the right is not single-valued, but we may conclude that 


(2.8) log p= log log (i/|¢|) +01) 
when z approaches the fixpoint in an interior angle. 


2.4. The coefficient of the Poincaré metric decreases when the region 
increases (this is essentially Schwarz’ lemma). Denote the euclidean distance 
from z to & by 8(z). If we compare Q with the circle about z of radius §(z) 
it follows at once that p(z) = 28(z)-. In case Qy is simply connected and 
does not contain œ an opposite inequality can be obtained by use of Koebe’s 
one-quarter theorem. One finds under these circumstances p(z) = $8(z)7. 

In the general case we use the majorization Q C Qe where Q, is the 
sphere punctured at three points Zo, 21,22€ X. We have p= po and po can 
be estimated by means of (2.3). It follows that 


log p(z) = — log | z— zo | —log log(1/| z— zo |) — O(1) 


in a neighborhood of zo. It is not hard to see that the remainder is uniformly 
bounded when z varies but stays away from z, z} If 3 is assumed to be 
compact we conclude that 

(2.9) log p 2 — log §— log log (1/8) — O(1) 

for sufficiently small 4. 


n, 
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3. Quadratic differentials. 3.1. In all that follows a dominant role 
is played by the quadratic differentials on Q. A quadratic differential is a 
holomorphic function $ on Q which satisfies the functional equations 


(8.1) (Az) A’ (2)? = (2) 


for all AET. More accurately, the quadratic differential is the invariant 
expression & dz, but it is convenient to use the same term for the coefficient ¢. 

The projection map induces a corresponding quadratic differential on S, 
namely by the relation ¢dz*—=¢d¢?. At a point p, with finite signature, let 
the projection be given by £— z" in local coordinates. Then $ = O (| & |**?/m), 
and since $ is single-valued it has at most a simple pole at py Conversely, 
if $ has at most a simple pole, then & is holomorphic. 

As soon as S is not compact the class of all quadratic differentials on Q 
is too extensive to be useful. We shall consider the following restriction : 


(9) Sol | das <>» 


(Q*) | @ |: =O (°). 


Observe that the integral in (Q) is meaningful because of (3.1). The 
quadratic differentials which satisfy these conditions form linear spaces which 
we denote by Q(T) and Q*(T) respectively. 

In terms of ¢ condition (Q) becomes 


(3.2) J 191 <=. 


Similarly, (Q*) yields |¢|—O(p*). In both cases 4 has at most a simple 
pole at points with infinite signature. In fact, for Q this follows directly 
from (3.2), and for Q* we may use (2.3) to deduce that 6=0O(|£]”) in 
terms of a local variable, and hence that the singularity is at most a simple 
pole. 

We shall let Q(8) and Q*(8) denote the spaces formed by all ¢ for 
pEQ(T) and dEQY*(T) respectively. If S is of finite type these spaces are 
identical, and we conclude: 


Lemma 2. If 8 ts of finite type the spaces Q(T) and Q*(T) are 
identical and of finite dimension. 


The dimension over the complex numbers is 3g + n— 3k where g is the 
sum of the genera of the surfaces S, n is the total number of points with a 


PER Soy ate 
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signature, and & is the number of components. It follows from condition 
(2.4) that there are non-zero quadratic differentials on each 9. 


3.2. We have just proved one part of the following result, which is 
particularly important for our purposes: 


THEOREM 1. The space Q(T) is finite dimensional if and only if S is 
of finite type. 


If there are infinitely many S, all of finite type, it follows from the 
remark above that Q(T) has infinite dimension. Suppose now that one Sı 
is not of finite type. If 8; has infinite genus there exist infinitely many linearly 
independent square integrable first order differentials 6, on Sı. If they are 
multiplied by a fixed one, 6, the 6,6, are linearly independent quadratic 
differentials, and they are integrable. Assume next that $; has finite genus. 
Then it can be imbedded in a compact Riemann surface 5; If §,—8; is an 
infinite point set we can find infinitely many quadratic differentials on S 
with distinct simple poles on 8,—S;. Their restrictions to S, are integrable 
and linearly independent. Finally, if ,—$; is a finite set there must be 
infinitely many p on S, and we can find infinitely many quadratic differ- 
entials with distinct poles among the py. Thus, whenever © is not of finite 
type, Q(T) has infinite dimension. 


4. Beltrami differentials. 4.1. We regard Q(T) as a Banach space 
with the norm 


161, Je dad 


and Q*(T) as one with the norm 


> læ = sup | ẹ | 07. 


One of our aims is to determine the conjugate space of Q(T). Several charac- 
terizations will be obtained, and their comparison will contribute to our 
knowledge of Kleinian groups. 


4.2. Choose an arbitrary o€ Q(T), not identically zero, and define 
a measure on S =— Q/T by dm = | ġo | dady. Evidently, a quadratic differential 
¢ belongs to Q(T) if and only if $/¢o is of class L> with respect to this 
measure. Therefore, every linear functional on Q(T) can be represented as 


i Pii | $o | 8 dedy 
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where 8 is a bounded measurable function on S. We may define ß as an 
automorphic function on Q, and we find that v= ¢o* | o| 8 satisfies the 
equations 

(4.1) v(Az) A’ (2) /A’(z) = v(2) 


for all AET. Such functions are called Beltrami differentials; we emphasize 
that v has to be bounded and measurable. We have proved that every linear 
functional on Q(T) is of the form 


(4.2) Í gv dady 
Dort 
where y is a Beltrami differential. 


4.3. Let B(T) be the linear space of Beltrami differentials, normed by 
|v Ilo, and let W (I) denote the subspace of those y which satisfy 


(4.3) Í. „P dady = 0 


for all p€ Q(T). Our result can be stated as follows: 


Lemma 3. The conjugate space of Q(T) can be identified with 
B(T)/N (T). 


Clearly, any characterization of N (T) will therefore be a characterization 
of the conjugate space of Q(T). 


5. The Fuchsian case. 5.1. Many problems in the theory of Kleinian 
groups can be reduced to the corresponding problem for Fuchsian groups. 
We shall therefore begin with a study of the Fuchsian case. 

To emphasize the distinction, Fuchsian groups will be denoted by the 
letter G. We assume that @ is discontinnous and acts on the unit disk 
D= {z| |z| <1}, but it need not be of the first kind. We shall constantly 
disregard the outside of D. Therefore, we shall set S(G) == D/G, and the 
notations Q(@) and Q*(G@) will refer to quadratic differentials in D. The 
corresponding remark applies to the spaces B(G) and N(G). Observe that 
p(z) =R(1— | 2 |#)+. 

We shall make frequent use of the known representation formula ° 


Of, (1—| 2 |")*1 22) + dedy 


*L, Ahlfors, “Some remarks on Teichmüller’s space of Riemann surfaces,” Annals 
of Mathematics, vol. 74, No. 1, 1961, p. 176. 
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which is valid as soon as ¢ is holomorphic in D and 


(5.2) S,11a—1219? dedy <o. 
This condition is dimou falfilled when $€ Q*(G). 

The identity 
5. 1— 2 \-# == 7(1— 2\-2 
(5.8) Sal dzi =t) 


will also be needed. 
5.2. With any Beltrami differential v€ B(G) we associate 


(5.4) Ty(t) = wf (2) (1 at) + dedy. 


A simple computation shows that Ty is a quadratic differential, and by use 
of (5.8) we conclude that Ty E Q*(G). In the opposite direction, ¢ E Q* (G) 
can be mapped on T*ġ =¢ġ(1— |z|): = 4p E€ B(G). Formula (5.1) 
takes the form TT*ọ =, or TT* =]. The operator T* is of course 
meaningful also when ġ € Q (G), but then we can no longer assert that T*ẹ 
belongs to B(G). 

As an abbreviation we introduce 


(5.5) SH RT 7 


and we use this notation as soon as the integral on the right is absolutely 
convergent. One verifies at once that 


(5.6) <a T a> — <ha Pte)" 


as soon as dh, E Q (G), p2 E€ O*(G) or vice versa (the bar stands for the complex 
` conjugate). 
Even more important is the following identity: 


Lemma 4. <p, TTV) = <o, v> for $€ Q(G), ve B(G). 


Both sides of the identity represent absolutely convergent integrals, and 
by (5.6) the left hand side can be replaced by <Tv,T*$>-. By virtue of 
(5.1) the equality <Tv, T*6y = <¢, v> is equivalent to 


fg (11219)? dedy f v(e) (1—8) dedy 
-f p(t) 1er aay fr) (1— ZZ)" dady, 
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an identity which is proved by subdivision into “fundamental regions sand’ — 
subsequent changes of the integration variables. The absolute convergence 
justifies the procedure. 


5.8. Let A(D) be the space of holomorphic functions which are inte- 
grable over D. For FE A(D) the Poincaré series 


(5.7) OF (2) — J F(42)4' (2)? 


converges and represents an element of Q (G). In fact, one obtains 


(5.8) y 1er S f |F] dedy. 
It is also easy to verify that 
(5.9) <@F; yy = Í, Fy dedy. 


5.4. We now deduce the most important result in this direction, which 
is due to L. Bers: ° í 


TurorE™m 2. The mapping T:B(G)—Q*(G) is a surjection with 
kernel N(@). Therefore, the conjugate space of Q(G) can be identified 
with Q*(G). 


That the mapping is onto follows from TT*==I. Another way of 
expressing Lemma 4 is to say that v„— T*Tre N(G@). Therefore, Ty == 0 
implies ve N(@). To prove the converse, let F be the function 3#*(1— 22) * 
with fixed ¿€ D. The definition (5.4) of Ty together with (5.9) gives 


Tv(£)- = <@F, v), 


and hence ve N(@) yields Ty = 0 as asserted. 

Specifically, we have shown that every coset of N(@) in B(G) contains 
an element T*ġ with ¢€ Q*(G), namely for 6—=Ty. This is of course the 
only element with this property, for T*¢¢ N(G@) implies 6=TT*d —=0. 


5.5. As an immediate corollary we obtain: 
Lemma 5. Every € Q(@) can be written in the form OF with F € A(D). 


Indeed, it follows from (5.8) that ® maps A(D) onto a closed subspace 
of Q(G). If it were not all of Q(@) we could find ¢ € Q*(@), not identically 
zero, such that <@F,T*$¢> = 0 for all FE A(D). By (6.9) this gives 


* Oral communication. 
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Í, FT*¢ dzdy =Q. 
D 


We choose again F(z) = 3a7(1—2{)~* and obtain ¢(f) =0, contrary to 
assumption. 


5.6. There is a generalization of Lemma 5 which will be of importance 
when we pass to the case of Kleinian groups. Let G, be an arbitrary subgroup 
of G. For any ¢o€ Q(G) we construct 


(5.10) 8o (2) = È po (4z) A’ (2)? 


where the summation is now over a set of representatives of the left cosets 
of Qo, one from each coset. Because ġo is a quadratic differential with respect 
to @, the choice of representatives is irrelevant, and one finds that || @o¢p | 
|]. Equation (5.9) is replaced by 


(5.11) Bodo v> = Lpo >> 


valid for all veB(@). It is to be observed that the first inner product is 
over D/G, the second over D/G). 


Lemma 6. Every pE Q(G) can be written as Bapo with go Q( Gr). 


Again, if this were not true we could find ¢€ Q*(@), $340, such that 
<Oobo, Tr) — 0 for all do € Q(G). According to (5.11) this gives (do, T*> 
— 0 for all ġo, and hence ¢ = 0, a contradiction. 


6. The general case. 6.1. We return to the case of an arbitrary 
Kleinian group T, except that we shall assume oo to be a limit point. This 
minor restriction has the advantage that the Poincaré series 


(6.1) OF (2) — F F (As) A’(a)? 


remains holomorphic for any FEA(N), that is, whenever F is holomorphic 
and integrable in Q. It is clear that ®F enjoys the same properties as in the 
Fuchsian case. 

We shall show that the conclusion in Theorem 2 as well as Lemma 5 
remain valid. As far as the conjugate space is concerned it is quite clear 
that we may restrict our attention to a single component Qy of Q and replace 
T by the subgroup Ty which leaves Qu invariant. It amounts to the same 
thing if we assume from the beginning that © is an invariant region with 
respect to T, but not necessarily the whole set of discontinuity. 

Let z=u(£) be a conformal mapping of D—{t||f| <1} onto the 


12 
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universal covering surface of Q. We introduce a Fuchsian group @.as follows: 
BEG if and only if there exists A € T such that 


(6.2) (Bf) = 4o (¢). 


It is evident that A is uniquely determined, and the mapping A—> B is a 
surjective homomorphism whose kernel we denote by Go. 
The equation 


(6.3) $E) —$(w(£))o"(C)? 


gets up a one-one correspondence between quadratic differentials with respect 
to Gand T. One verifies that Q(T) corresponds to Q(@) and Q*(T) to 
Q*(G). A similar correspondence between B(T) and B(G) is defined by 


(6.4) P(E) =r (o (t) yE (£) (t). 
The identity 
(6.5) ft Weis Í, ĝin 


prevails. We conclude: 


THEOREM 3. The conjugate space of Q(T) has a canonical identifica- 
tion with Q* (T). 


6.2. For the counterpart of Lemma 5 it is also true that it suffices to 
consider a component Qy and the corresponding subgroup Iy;. To see this, 
let ©, denote the theta-operator with respect to Ty. If = ®,F in Oy with 
FEA(Q,), extend F to all of Q by setting F==0 outside of ®,. At the 
same time & is extended to all of Q; as a quadratic differential. It follows 
that ¢—©F in Q, and this is what we wish to prove. It is therefore no 
restriction to assume again that © is an invariant region for I. 


Lemma Y. Every pEQ(G) can be written as OF with FEA(D). 


We use the same notations as before. By Lemma 6 it is possible to write 
p = opo With o€ Q(G.). The relation 
(6.6) poft) =F (a(t) J)o (£)? 
defines F uniquely, and one verifies that @a¢o (£) = OF (w(€) )w’(€)*, and this 
makes $= OF’, 


7. Direct characterization of N(IT'). 7.1. In this section we shall 
derive some results which, as far as we are able to judge, cannot be obtained 
by reduction to the Fuchsian case. It will be convenient to assume, in this 
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connection, that the points 0, 1, œ belong to 23. All invariantly formulated 
results are of course independent of this hypothesis. 

The method we shall use is intimately connected with infinitesimal 
deformations of conformal structure. However, there will be no need to 
make this connection explicit. 

Given v€ B(T) we construct 


a) O= f AL ey. 


The integral converges because the rational function in brackets has a third 
order zero at œ and only simple poles at £, 0, and 1. It represents a con- 
tinuous function in the finite plane. What is more, it satisfies a uniform 
Hölder-type condition. 

(7.2) (F) — f (ĉa) | S&C | é — é: | log 1/| a — t: |, 


for instance for | ĉ& — £: | 1/2. At œ it is of order O(|£|log|¢|). 
It is well known that f has locally square integrable distributional 
derivatives, and that 


(7.3) fam 4(fo—‘*fy) =v 
almost everywhere (provided that we set v—0 on 2). 
7.2. We shall prove: 
Lemma 8. vEN(T) tf and only tf f—0 on 3. 





The necessity is immediate. Indeed, for any fixed €€ the bracketed 
expression in (7.1) is a holomorphic and integrable function F on Q. 
Therefore, ve N(T) implies 


f „F dedy = <@F, vy = 0, 
Q 


u 


and hence f(£) == 0. 

To prove the sufficiency, let A be a C” function which vanishes in a 
neighborhood of X. In addition we require that A and fàs be bounded. 
Under these conditions, if FE A(Q) Stokes’ formula yields, with the help 
of (7.3), 


wen) f, AF y dady -Í fr dedy = -Í Perf dedy. 


Tf we can choose A, depending on a parameter, in such a way that A tends 
boundedly to 1 and fàs tends boundedly to 0, it will sollo that <OF,vy = 0, 
and hence, by Lemma 7, that v€ N (T). 
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We are assuming that f—0 on 3. As before, 5(z) denotes the distance 
from z to a. We deduce from (7.2) that 


(7.5) | f | S 081081/3 


for §<= 8, say. We choose Se. 

For the moment, let us ignore the condition that A be of class C*. 
Given «> 0, let A(t) be 0 for OS te, 1 for t= 2e, and linear between e 
and 2e. We shall set 


(7.6) | A(z) — AL (log log 1/8 (z))*] 


if 8 <8 and A(z) = 1 if $=. For e small enough, A will be continuous 
and identically zero near 2. 

If 8(z) were differentiable, the obvious inequality |d(2,) —8(z2)| 
<s|n—2z| would yield || =1, and hence 


| Ag | SS e787 (log 1/8) (log log 1/8) * 


in the part where A is not constant. Since (loglog1/8)+< 2 for these 
values it follows that = 
| As | S 46 (log 1/8)7, 


and in view of (7.5) we obtain | Af | S 4Ce throughout O. The desired con- 
clusion follows. 

The reasoning is completed by an obvious smoothing process, which we 
need not explain in detail. First, we replace ö in (7.6) by a smooth mean 
value 5* obtained by convolution. In the relevant part of the plane 6* will 
satisfy the same Lipschitz condition as ê. Secondly, A has to.be replaced 
by a smooth function whose derivative is nowhere much greater than et. 
With these modifications the argument goes through exactly as before. 


7.3. An alternative characterization of N(T')) is the following: 
Lemma 9. vE N(T) if and only tf f(Az) —f(2)A’(z) for all ACT. 


The condition means that f/dz is invariant, in which case f is said to. be 
an inverse differential. 

The definition (7.1) of f shows that f(0) 0. If the condition in the 
lemma is fulfilled it follows that f(A0) =0 for all AET. But the points 
AO are dense on 3 and f is continuous. Therefore f vanishes on 2, dnd 
Lemma 8 shows that ve N(T). f 

Consider now the function 


(7.7) Pa(z) —f(A2)A’(2)*—fie). 
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By use of (7.3) we obtain 
(7.8) (P4)z—=v(Az)4’ (2) A’ (2) *#—v(z) = 0 


almost everywhere; in particular, also on 3. Furthermore, the derivatives of 
Pa are locally square integrable (except perhaps at Ao). It follows that 
P, is analytic, and if it vanishes on 3 it must be identically zero. This proves 
the lemma. — 

A more detailed investigation of the singularities at © and Aoo shows 
that P4 is always a quadratic polynomial. It is of some interest to note the 
formula 


(7.9) Pas(2) = P4(Bz)B’(z)* + Pa(z). 
7.4. The last lemma leads immediately to the principal result: l 
Trmonem 4. IfT is finitely generated, then S=Q/T ts of finite type. - 


Indeed, all relations f(Az) ==f(z)A’(z) are consequences of the corres- 
ponding relations for the generators. On the other hand, each relation is 
equivalent to the vanishing of the coefficients of P,, and thus to three linear 
conditions on y. For a finitely generated group the space B(T)/N(T) has 
thus finite dimension. By Lemma 3 and Theorem 3 this means that Q* (T) 
is finite dimensional, and hence the same is true of Q(T). We apply Theorem 
1 to conclude that 8 is of finite type. 


8. Invariant regions. 8.1. It is possible to obtain more precise infor- 

mation by adding the hypothesis that one or several Q, are connected, and 
hence invariant under the full group T. Such groups have been called function 
groups.* 
_ The fact that all invariant regions O; have the same boundary 2% does not 
by itself preclude the existence of any number of such regions. However, 
the existence of nonelliptic fixpoints does impose a severe restriction. The 
following theorem was communicated to me by R. Accola. 


THEOREM 5. There are at most two invariant regions Oy, and tf there 
are two they are simply connected. 


For the simple proof, which is purely topological, we refer to a forth- 
coming article by Accola. 


8.2. I£T is finitely generated we are able to prove a more precise result: 


tL, Ford, Automorphic Functions (2nd ed., Chelsea, 1851), p. 64. 
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THEOREM 6. Suppose that Q, and Q, are invariant regions for the finitely 
generated group T. Then §S=Q/T has only the components S,;—0,/T and 
2==02/T. Moreover, S, and K, are homeomorphic with isomorphic signatures. 


Since T is finitely generated we need not distinguish between Q(T) and 
Q*(T). We shall denote by Q; the subspace of quadratic differentials that 
vanish outside of Q. The main part of the theorem is an easy consequence of 


Lemma 10. If Q, is connected, then dim Q <2 dim Q,. 

Indeed, under the hypothesis of the theorem the lemma yields dim ©, 
+ dim Q: S dim Q <S 2 dim Q.. Hence dimQ,=dimQ, and by symmetry 
dim Q, == dim Q.. Furthermore, dim Q = dim Q, + dim Qa, and this shows 
that there is no room for a third component. If we can show that S, and 8, 
have the same signature it will follow, by the formula for the number of 
linearly independent quadratic differentials, that they have the same genus. 

The points with finite signature arise from elliptic fixpoints, and it is 
easy to see that each elliptic transformation must have one fixpoint in 0, 
and one in Q; (the simplest way to see this is by conformal mapping of 0, 
and ©, on the unit disk). It is therefore evident that the points with finite 
signature can be matched in pairs, in such a way that corresponding points 

. have the same signature. 

The facts for points with infinite signature are quite similar. We know 
by Lemma 1 that any such point, whether on S, or Sz, determines a class of 
conjugate parabolic transformations. In the present situation the converse 
is also true. Let AET be parabolic. We map ©, conformally on the unit 
disk D and use the construction in 6.1 to determine an isomorphic mapping 
of T on a Fuchsian group G. The image B of A is necessarily parabolic. 
In the elementary case of a Fuchsian group it is quite evident that B corres- 
ponds to a point on 8, with infinite signature (M. Heins has proved this for 
arbitrary Fuchsian groups). Moreover, non-conjugate transformations corres- 
pond to different points. It follows that the points with infinite signature 
are indeed in one-one correspondence. 


8.3. It remains to prove Lemma 10. Let us denote by Q’, the space 
of quadratic differentials which vanish on Q,. Given $€ Q’, we form v= ¢p?, 
which is a Beltrami differential, and construct 


5M. Heins, “On Fuchsoid groups that contain parabolic transformations ” (Oon- 
tributions to funotion theory), Tata Institute, Bombay, 1960. 
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6D O= f OE0 ddy 


for £€0,. One verifies that Sd is a quadratic differential. Because v is 
bounded the integral is majorized by 


z— é |* ded 
Serié aed 


which is a multiple of 8({)*. Since Q, is simply connected 5({) is com- 
parable with p(¢) (we are assuming that œ € 3). It follows that Sẹ € Q. 

We shall show that the antilinear mapping S: Q'ı—> Q. is one to one. 
Assuming that 0,1, œ% € 2 we construct, as in 7.1, 





z 


6D FQ WETO Feen 


If Sp—0 we see by comparison with (8.1) that f” (¿) ==0 in Q,. Hence 
f(t) is a quadratic polynomial in Q,. Its behavior at œ shows that it is in 
fact a linear polynomial, and because it vanishes at 0 and 1 it reduces 
identically to zero. By continuity f ==0 on 2, and we conclude by Lemma 8 
that ve N(T). Since p= dp? this gives $—=0, and we have proved that 9 
is one to one. 

We emphasize that the connectedness of Q, is essential for the proof. 
If Q, were not connected we could merely conclude that f is a quadratic poly- 
nomial in each component, but not necessarily the same in all components. 
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ON GENERALIZED ABELIAN INTEGRALS OF THE SECOND 
KIND AND MODULAR FORMS OF DIMENSION ZERO. 


By Marvin ISADORE Knorr. 


I. Introduction. This paper generalizes the results of [1] in a manner 
described below. Let T(j), j==2,3,--- denote the principal congruence 
subgroup of the modular group T(1). By a generalized abelian integral (or 
GAI) for T(j) we will mean here a function f(r), regular in the upper half- 
plane, Im(r) > 0, and such that for Im(r) > 0, 


f(Vr) =v(V) f(r) HEN), for VET ()), 


where v(V) and C(V) are independent of r, and |v(V)|—=1. The numbers 
C(V) are the periods of f while v is a character on T (j). We note that f(r) 


is a GAI for '(j) if and only it I f(r) is a modular form of dimension — 2. 
T 


While in [1] the discussion was limited to the case v=1, that is, to 
.the case of abelian integrals, we here carry over all of the results of [1] to 
the class of GAI’s, subject to the rather natural restriction on the character v 
that there exists a positive integer n such that l 


(1.1) 0(V) —1 for all FET(nj). 


Such a v is called a congruence character. This restriction on v is imposed 
to insure that certain exponential sums, which are closely related to Klooster- 
man sums, have a nontrivial asymptotic estimate (cf. 8 II.3, esp. (2.6)). 

If f has at most a polar singularity in the local uniformizing variable at 
each parabolic cusp (cf. § II.1) of 7, a fundamental domain for T'(j), then 
we say that f is of the second kind; if f is regular in the local variable at 
each cusp, we say that f is of the first kind. If f is of the second kind and 
C(V) =0 for all Ve T(j), then f is a modular form of dimension zero for 
T(j). For convenience we introduce some notation. We will let [T (j), v]: 
be the vector space (over the complex numbers) of GAI’s of the second kind; 
[T (j), v]ı will denote those of the first kind; as usual {T(5),0,v} will denote 
the space of modular forms of dimension zero for T'(j). 
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Research supported in part by National Science Foundation grant number G-14382, 


480 


f 


GENERALIZED ABELIAN INTEGRAIS. l 431 


Our main results are the following. 
(i) Construction of an explicit basis for [T (j), v], (Theorem (4.1)). 


(ii) Construction of an explicit basis for [T (j), v]a modulo [T (f), v]ı. 
This combined with (i) gives a basis for [T (j), v]a (Theorem (4.4)). 


(iii) Explicit calculation of the Fourier coefficients of elements of 
{T(j),0,v} (Theorem (5.3)). These are of the same general form as the 
Fourier coefficients of automorphic forms of positive dimension on general 
H-groups which have been computed by the circle method (cf. [3]). 


It is to be kept in mind that these results are obtained only for congru- 
ence characters v. 

A key step in the derivation of (i) and (iii) is the use of a “gap 
theorem” for automorphic forms due to Petersson [4, pp. 460-1]. This is 
a generalization of the Weierstrass gap theorem which occurs in the classical 
theory of compact Riemann surfaces (cf. [6, p. 272]). The latter is sufficient 
for the case v==1 and was indeed used for this case in [1]. 

For the most part the results will be given without proof, the proofs being 
similar to those of corresponding statements in [1]. 

These results can be carried over to arbitrary congruence subgroups T 
of T(1), that is, to groups T such that there is a j with T(j) CTCT(). 
The changes that have to be made are ones of detail only. 


II. Preliminary remarks and definition of the basic functions. 


1. Let Ma (a =1,2,:--) be the elements of T(1), with M, = I = G J 


Here we will not distinguish between the linear fractional transformation 


vu LP und the matrices + ¢ a Let F; be a fundamental domain 


er-+d 
for T(j) with © as a cusp. Write Pa—Ma7'(o); in this way ge get all 
parabolic cusps Pa of T(5j) with P,—oo. It is known that the subgroup of 
T(j) leaving Pa fixed is a cyclic group with generator T'e = Ma SMa, where 





s—(j 4 > The set of Pa consists of all rational points on the real line 


and the point œ. At a parabolic cusp P= Pa, the local untformizing variable 
is defined by 

amt 
silr —r/s 
==exp(2mt7/j), if Pao. 





tp == ta = exp | yl if P==er/s<o, (r,s) ==1 
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Let v be a character on T (j), that is, a homomorphism of T (f) into the 
unit circle of the complex plane. Note that Te€I(j) and write v(T«) 
— exp (2rixa), OX xa < 1; for convenience write v(T1) =v($) = exp (2arix), 
0S5x«<1. 

2. Let y be a positive integer and let Ma = © J be a fixed element 
of T(1). Then we define §(Ma) by 


&(M)-1l,ifc=0, a= d = + 1 (mod j) 





GER = 0, otherwise. 
Put 

l w\ 2 

am (j, v, Ma, 0) = üm (v, Ma, 0) -(7)3 3A (m, k, v, May v) 
1 
(y L (F Vato ee), if mtr>0 

(2.2) m -+ k j 

Sa ta) Set (Ob lle) a ae, 

j k=l 

where 


A (m, k, Vy Ma, v) =a a 0 (Ma Vi-n) 
(2.8) aoe 
EB) + (m -Ha)A)] 


and I, is the modified Bessel function of the first kind. In (2.3) h’ is any 
integral solution of hh’ ==— 1 (mod k); we put W == — k*(hh’ + 1) and define 


[4 


Yen E E a The superscript « appearing in (2.2) and (2.3) indi- 
cates that the sums are restricted by the condition 
(2. 4) Vz, -r= + Ma (mod j), 


where the congruence is elementwise. This condition is to be understood in 
the sense that each appropriate lower row (k,—A) occurs exactly once and 
that we are then to find any (h’, i’) such that —hh’ —kk’ ==1 and such that 
(2.4) is satisfied. Of course, (2.4) implies that Ma*Vy-»€I'(j), so that 
v(Ma*Vz,+) is defined. (The bar here denotes complex conjugation, as 
usual.) 

The ambiguity in the choice of (h’,k’) leads to a possible ambiguity in 
the definition (2.3) since the summand in the right hand side of (2.3) 
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depends upon h’: However (h’, k’) can be replaced only by (W + tjk, k’ —tjh), 
with ¢ an integer. Then V,. is replaced by 


W+tik K—ih = SV» 
k —h 


and 


5 (Ma*Vx,-a)exp[— vn) 
is replaced by 
HSV ep Er (v — ra) (V + tjk) ] 
m (Lat Mat Vyr) 67i exp[— m (ii, 
so that the summand in (2.8) is well-defined. 


3. We now define the basic functions 


Alj,v, Ma, v57) =A (v, Ma, v37) 
by 
Ay May 051) = BMM T er Ye] 


(2.5) 
+ È am (v, Ma, v)exp{2ri(m + x)r/j}; 


for Im(r) >0, where V,4€T(1) has the same second row as Me. The 
calculation used in the preceding paragraph to show that A(m,k,v, Ma, v) 
is well-defined proves that the first term on the right hand side of (2.5) is 
independent of the particular choice of F.a and therefore is well-defined. 

The functions A are regular in the upper half-plane, Im(r) >0. The 
proof of this fact uses the nontrivial asymptotic estimate 


(2.6) A(m, k, v, Ma, v) = O (k*t), «> 0, as k> +0. 


The constant involved in the estimate can be chosen independent of m. That 
(2.6) holds for all sums A(m,k,v,Mo,v), with v a congruence character 


(that is, satisfying (1.1)), was shown by Petersson [5, pp. 16-19]. It is 
worth noting that any estimate of the type 


(2.7) A(m,k,v, Ma, v) — 0 (k), 8> 0, 8 k> +o 
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` ‘would suffice to carry through our methods, and in fact, all of the results 
presented hold if » satisfies (2.7). The estimate (2.6) is critical in the 
proof of the following fundamental result (cf. [2], for details). 
* * 
Tumonmt (2.8). (i) Let V—=(~ ajero). Then, providing v 
satisfies (1.1), we have, for Im(r) > 0, 
(2.9) Av, Ma, v; Vr) =A (v, MaV,v*;r) + 0(Me, V), 


where w( Ma, V) is independent of t, and v* is the character on T(j) defined 
by v*(T)=v(VTV*), for TET(j). (Note that v* satisfies (1.1), if 
v does.) 


(ii) If y==0, then o(Ma, V) = 0, and if y 0, then 
o(Ma, Y) = p(y, Ma, V, F) + ø (v, Ma, v, F) > 
here; letting MaV — Ms, 


o(y, Ma, U, V) 
ji B 5 (Ms Vim ee) 
Kae wars im d a jk 
(2.10) km 
— 228 B(M Vn mexpi rifo — ra) /ih p 
va E 


where t is a certain positive constant and J(K) is a certain trapezoid in the 
k—m plane (t and J (K) depend upon V), and 


(2.11) p(y, Ma, v, V) = p (v, Ma, v) — p (v, Mp, v*). 
In (2.11), we have put 


¢(v, Ma, v) == $to (v, Ma, v), if x=0 


genel = 0 ‚„Ex>0. 


III. Generalized abelian integrals. 1. In Theorem (2.8), if we let 
VET(5), then we observe from (2.2)-(2.5) that v*== v, and A(v, Ma, v*; r) 
—v(V)A(v,Ma,v;7). Hence applying the reasoning of the proof of Theorem 
(3.10) in [1], we obtain 


THEOREM (3.1). If v satisfies (1.1), then for 


Ma=(¢ > er(l), A (v, Ma,v;r) 
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is in [T(j),v], and has precisely one pole cr order y—xa tn F; That is, ` 
As. regular, in Im(r) >0 and 
O forvm(" Jeri), me >0, 4770 
A(v, Ma, v; Vr) —v(W)Alv, Me, ¥57) 
=o (v, Ma, v, V) + pv, Mo, v, F) 


(8.2) en nr Y), af x>0O. 
o(v, Ma, v, F) + $t (v, Ma, v) (1—»(V)), if x, 
with o defined by (2.10) and p by (2.11)-(2.12), and if y 0 


A(v, Ma, v; Vr) UN Han), 


ns with F; chosen such that Pa is a parabolic cusp of F,. about this 
cusp A has an expansion of the form 


(3. 3) e (v, a) tar) + > Omta™**e, 
m=0 
where 
e(v, a) —exp(—2ni(y—xe)B/j), if c= 0 
= exp(—2at(v—xa)a/je), tf c0, 


(ii) at any other cusp Pı of F; à has an expansion of the form 


(3.4) 


(3.5) E bmi, 
m=0 
2. We now introduce the series supplementary to A(v, Ma,v;r). Recall 
that v is a positive integer and define y” by 
yY = 1 —r, if ra> 0 
=—y, İf ka=). 
Let an(v’, Ma,5) be the result of replacing v by 7 and v by y in (2.2). Note 


that xa is then replaced by x'a == 1 — xa, if ka > 0 and by K'a=0 if ka= 0. 
The same is true of x’ which replaces x. We define Ä by 


N 


AY, Ma, Ö 5 r) = 8(Ma)v(Ma*V,,a)exp[— nr u 


(3. 6) 
+2 aml, M, d)exp{2ari(m + K)r/i}- 
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Notice that in contrast to the definition (2.5) of A, the series (3.6) has no 
term corresponding to m == Q, ifxe=0. The definition is given this way as a 
matter of convenience and has the effect of simplifying some of the succeeding 
calculations. 

We observe that the proof of Theorem (2.8) does not in any way depend 
upon the fact that v is positive. Hence Theorem (2.8) applies to Â and 
we can deduce the counterpart of Theorem (3.1) for Â. It is, namely 


THronem (8.7). If 0 satisfies (1.1), then for M.ET(1), A, Me, G37) 
is in [T(j),v]ı. That is, Â is regular in Im(r) > 0, satisfies the transfor- 
mation equations (3.2) of Theorem (3.1), with o(v, Ma, v, V), and plv, Ma, v, V) 
replaced by o(/,Ma,t,V) and —p(v’,Ma,t,V), respectively, and at each 
parabolic cusp of F;, \ has an expansion of the form (3.5). 


We see that y — x'a == — (yv—kxa) and therefore by (2.10), (2.11)- 
(2.12), and (2.2)-(2.3) 


(3. 8) a(¥, Ha, 0, V) =F (v, Ma, v, V) 
o(v, Ma,5, V) —0, if K> 0 
er) St 
If now A(r) is a finite linear combination of the functions A, say 
A(r) 22:6, a)A(v, Ma, v57), 
we define A(r), the function supplementary to A(r), by 
A(r) = 2 Boy, a)A(Y, Ma, 337), 

We have the following fundamental relationship between A(r) and A(r). 
Trrsorem (3.10). A(z) € {T(5),0,0} if and only if K(r)=0. 
Proof. For x>0, by Theorem (3.1), if v—(° .)e r(j), 

A(Vr) —0(V)A(r) =ZEB(4a)o(y, Ma v, V), if y0 
= 0, if y=0. 

On the other hand, by Theorem (3.7) and (3.8)-(3.9), 

A(Vr) —ö(V)Â (r) = 22 b(v, a)o(v, Mav, V), if y 0, 


=0, if y==0, 
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Hence A(r) € {P(j), 0,0} if and only if A(r) € {T(j),0,#). But A(r) is 
bounded in $, and hence is a modular form of dimension zero only if it is 
constant. By (3.6) the constant must be zero. 


If x=0, then by Theorem (3.1), 
A(Vr) —v(V)A(r) =~ Zab, a)o(y, Ma, v, V) 
+4(1—0(V)) E Ed(s an Mav), if y0 
= 0, if y=0. 
By Theorem (3.7) and (3.8)-(3.9), 
A(Vr) —0(V) A(z) =X D 5(y,4)e(v, Ma, v, V) 
+4(1—0(V)) BE5(,4)do(y, Ma), if #0 
=0, if y—0. 


Hence, again A(r) € {I'(j),0,v} if and only if A(r) € {T'(j), 0,0} and this 
happens if and only if A(r) ==0, by (3.6). 


IV. Basis theorems. 1. In order to obtain our principal results we 
need the following important generalization, due to Petersson [4, pp. 460-1], 
of the classical Weierstrass gap theorem. 


Prrersson Gap Turorem. Let u be the linear dimension over the 
complex numbers of the space of cusp forms in {T (j), —2, v}. Then given any 
parabolic cusp Pa of Fj, there exist exactly p integers w, 0 < Ww <` ++ < Wp 
depending on Pa, such that there does not exist an element of {T (j), 0,9}, 
having as its only singularity in F; a pole of order w— na at Po, L St Sp. 


Remark. This is actually a very special case of Petersson’s theorem, 
which deals with a very wide class of groups and automorphic forms of any 
complex dimension. Furthermore the restriction to parabolic points is unneces- 
sary and has been made here simply to avoid the problem of defining the 
order of a pole at an arbitrary point of F;. Note that we have defined the 
order of a pole at a parabolic cusp Px in terms of the expansion of the 
function at'that cusp. It is not an integer unless x'a = 0. 


We fix our attention on a single, arbitrarily chosen parabolic cusp 
P, of a fixed fundamental domain F; with © as a cusp. Write P,==1/s, 
(r,s) =1 (possibly Pa==1/0 =œ). Then there are integers ti, u such 
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that u-( _“)er(), and then Myt(@)—P,. By Theorem (3.1), 
since @ satisfies (1.1) if and only if v does, A(v, Mm 357r) is in [T(5),#],, and 
has ‘a pole of order v„—x’, at Pa and no other singularity in ¥; Consider 
the functions A(w, My, D; r) =A(r), where w (1Si<Sy) is the sequence 
of integers connected with the cusp Pa in the Petersson gap theorem. 

THEOREM (4.1). The functions A(w,M,v;r)=Ä(r) (SiS p) 
are linearly independent over the complex numbers and, together with the 
constant function 1, they form a basis for [T(j),v]:- 


Proof. By Theorem (3.7) each ke [I'(j),v]1. I 


G(r) = È bål) + Dan =0, 


then by (3.6), banı = 0, and by Theorem (3.10), 


g(r) _2 Bas(r) € {T, 0,5). 


Unless b; = 0 for alli==1,- > -, p, g(r) is a modular form of the type excluded 
by the Petersson gap theorem. Hence b, ==> by = banu 0. 

But since the space of cusp forms in {T(j),—2,v} has dimension u, 
[Tr,v], has dimension »-+1 and therefore Ay,’ * *,Ä„,1 form a basis for 


[C(7),v]s. 


2. Let P,=w, Pa: --,P, be the parabolic cusps of F,. It is known 
that q= [T(1): r(j)]/j. Suppose f(r) € [T(5j),v].. Then a linear com- 
bination of the functions A(v,Ma,v;r) (a=1, > ',‚9;v»>0) can be so 
constructed that its principal part agrees with the principal of f(r) at each 
parabolic cusp. That is, there exist constants b(»,«) such that 


Q 3 
(4.2) n—2 bla), Mu,v;r)€E-T(j),v)ı. 
By Theorem (4.1) there are constants b; (1S¢p-+1) such that 
f(r) = 3 Dd vy, a)A(v, Ma, 057) 
a1 y 


(4.3) ie 
HbA, Mr v;r) + Oust. 


That is, we have 


THEOREM (4.4). The functions r(j,v,Ma,v:7) (1SaSqv>0) to- 
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gether with 1, Â (w, Mm vT), © ‚Aw, My, v57) form a basis for [T(j),v]». 
Here P, is any parabolic cusp of F; and w,,- - -,w, ts the gap sequence at Py. 

. V: Modular forms. 1. An element of {T (j), 0,v} is in particular, in 
[T (j), v]a and can therefore be expressed in the form (4.3). We conclude 
that in this case b,,- - -,b, are all zero. That is, we have 


Tuxormm (5.1). If f(r) € {T(j),0,v}; then 


(5.2) fo) 2 Zb, NT EN UN 


where the linear combination on the right hand side of (5.2) is so constructed 
that its principal part agrees with that of f(r). at each parabolic cusp of F; 
Furthermore, if v is not identically 1 on T(j), busi =0. 


Proof. With f(r) expressed as in (4.3), let 


4) =f EE ail, May 357) +$ ba (ws Ki) 


The calculations used in the proof of Theorem (3.10) show that f(r) € {T(j), 
0,v} if and only if f(r) € {T(7),0,5}. If some 40 (1SiSz), f(r) is 
a modular form of the type excluded by the Petersson gap theorem. There- ` 
fore, b, = b; == - ‘=b, = 0. 

Furthermore, f(7) € {T (7), 0,0} is tiei bounded in the upper half- 
plane and therefore a constant. By the definition (3.6) of Â, we conclude 
that f(r) =bn If væÆ&1 on T (j), bm == 0, since a nonzero constant is not 
in {T (j), 0,7} in this case. 


2. We are now in a position to read off the Fourier coefficients of 
f(r) € {T (j), 0, v} in its expansion about oo, that is, in powers of exp (2zir/j) 
directly from (2.2)-(2.3) and Theorem (5.1). The result is 


Teeorem (5.3). Let f(r) € {T(5),0,v} and let the principal part of 
f(t) at Pa be Sb(v, a) tao), forlsaxq. Write the Fourier expanston 
x» 


of f(r) in the variable t, == exp (2rir/j) as 
f(r) =D b (v, 1) e-2Ti(»-x)T]] + 5 es, 
a m0 
Then, if v>&1 on T(j), the coefficients am, m = 0, are given by 


(5.4) tin 3 Eb (142) (r,a) am (04 Mas 1), 


13 
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where Am(v,Ma,v) is defined by (2.2) and e(v,a) by (3.4). Ifv=1 on 
‘T(j), the am are determined in the same way for m= 1. 

We could obtain the expansion about each of the other cusps of F; by 
applying Theorem (2.8), part (i) to f(r). 


Tue UNIVERSITY OF WISCONSIN, 
MADISON, WISCONSIN. 
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A CLASS OF SINGULAR INTEGRALS.* 


By B. Frank Jones, JR. 


i. Introduction. A. P. Calderón and A. Zygmund [1] initiated a study 
of singular integrals which generalize to n-dimensional space many results 
concerning the classical Hilbert transform. Their results have had wide’ 
application to partial differential equations, partly due to the fact that certain 
derivatives of fundamenal solutions of Laplace’s equation satisfy the conditions 
required by Calderön and Zygmund for kernels in the singular integral 
operators. The present article treats a different class of singular integrals; 
these generalize integral operators with kernels which arise from parabolic 
differential equations with constant coefficients. We now turn to an example 
of such a situation. The analogy with the case of Laplace’s equation was 
described in [2]. 

Let P(€) =P (é: - <, é) be a homogeneous polynomial of even degree m, 
such that P(€) has negative real part for real& Let D = (0/0a,- - -,4/82,). 
Then the parabolic equation 


Bu/öt = (—1)™2P(D)u 


has for a fundamental solution the function 


Dat) — (2e) f explie-€ + tP (£) dE i>0 
(ef. [4], pp. 97-102). Now let 
N ĝo 
k(z, t) = DAT (2, t) = Ta), 


where p= (py,‘ ` `, pn) is fixed and p+: tm. Then 


(1.1) (2,4) = (2r) f (ie) exp[iz: -+ tP (£) J, 
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where (i£)?— (ig): (in). Now let us make the en of variable 
y= iimg in (1.1). Then 
(1.2) Mad net f (iy) explitme-y +P (y) Jy. 


We therefore obtain for k(z,?) the relation 


(1.3) (ama, at) = umka,t), a> 0. 


Note that this relation could also be expressed in the form 


a 1 T i 


which follows immediately from either (1.2) or (1.3). 
For example, for the heat equation du/dt — d*u/dz?, 


T: 

PR yz 7 
From estimates on T ([41, Theorem 39) it follows that any derivative 

of T decays as fast: as exp[—c|z|*/@-)] as |2|—>w, where c is a positive 

constant; here |æ |= (22+: <- +22)"/?. Therefore, as k is a spatial 

derivative of an absolutely integrable function, it follows immediately that 


` k(x, t) = 





ae emitt, 


(1.5) Jr@de-0. 


We can express (1.3) by saying that k is homogeneous in a certain sense, 
and (1.5) by saying that k has mean value zero on hyperplanes orthogonal 
to the t-axis. As was pointed out in [2], these two properties are entirely 
analogous to corresponding homogeneity and mean value properties assumed 
in [1]. 

In dealing with parabolic un it is frequently necessary to solve 
the equation 
(1.6) er bu/6t — (—1)"?P(D)u—f, 


where f(z, t) is a given function defined for (say) all s in R” and all positive t. 
A particular solution of (1.6) may be expressed in the form 


u(z,t) -=f S,re-81- 16 r) dédr, , 


in case f is (say) Hölder-continuous and has compact support. This solution 
satisfies the initial condition u(z,0)==0. Using the same notation as above, 
it then alas that ([3], Théoréme 3) 
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(1.7) Druat)imf [Eesti nflErdir. 


Note that the function k(z— é t—r)f(é r) actually fails to be integrable 
over the set #=R"xX(0,0). Hence, the integral in (1.7) must be taken 
in the indicated sense. In our case of Hölder-continuous f the limit in (1.7) 
exists and, moreover, the iterated integral 


IR Lf rast rende 


exists in the usual sense. 

The principal result of this paper implies that if f€ £,(#), ‚where 
1<p<o, then the integral in (1.7) converges in L,(E) to a function fo, 
and || folz, Ap | f lzm, where the constant A, depends only on k and p. 
This is a direct analog of a basic result in [1]. The proof is quite similar 
to the corresponding proof in [1], and we shall often refer to that paper in 
the development which follows. 

Of course, an immediate application of the theorem is the a priori 
estimate || Du |z, S 4p || f llc, for the solution of (1.6) satisfying 
u(x, 0) =0. 


2. Description of the singular integrals, In this section a class of 
kernels will be described, generalizing those introduced in Section 1 connected 
with parabolic differential equations. We make the following assumptions: 


I. $(¢) is a non-decreasing positive continuous function for 0 < t < œ% 
such that lim $(t) 0, lim g(t) ==%; 
t0 t>o 


II. Q(z) is a measurable complex-valued function on Ar and 


1 T 
ted =a la) 105 
TIT. f+ 12) 19@)| de< and | 9(z)de—0. 


These are certainly fundamental assumptions on the nature of k(z,t); II 
and III correspond to the relations (1.4) and (1.5), respectively. The 
remaining assumptions are more or legs technical in nature. 

We require the following of (t). There exists a positive constant c 
such that: 


IV. SR dt<c$(a), O<u<o, 
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2 1 c 
—— di —~-, 0<a<o; 
J. na*r 
(2t) ; 
y. st) So 0<t<o; 
VI. for0<t<o and |ê] S 1/23, 


Ka er 
Finally, we assume that Q(z) satisfies the following for some positive c: 


VIL f |o(2)—a@-+y)|deSelyl, ver; 
VIII. So) —9( (1 +8)2)| deo 8 | for |3|<1/2; 


IX. Sun Q(«)| de £ ca” for a>0. 


It should be noted that all of these assumptions are almost trivially ful- 
filled in the case of the kernel k(x, t) treated in Section 1, where ẹ (t) = i. 
Also, if $(t) == tf for some positive 8, then it is seen immediately that the 
conditions IV, V, VI are trivially satisfied. 

Throughout this paper c shall stand for a (large) positive generic constant, 
which depends only on the kernel k and the dimension n of the space. 

A formula for a change of dummy variable in a certain type of integral 
will frequently be needed ; for convenience in later manipulations the formula 
will now be stated. If O <a <b<Sw and E C R", then 


(2.1) Saf enren- f Efa, AEP ($ (76) de. 
$r) 


This relation follows immediately by using the expression II for k(&,r) and 


replacing é on the left side of (2.1) by £ =t and then replacing & 


by é Here F(é,7) stands for various functions which will enter the discussion. 
Now some truncations of k will be defined: if «> 0, let 
k(x, t), Ze 
(2.2) ke(z,t) a tee 
EO0<e<T<%, let 


ke(z,t), tST, 
(2.3) kur(2,t) = ue oe 
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We next define two convolution operators corresponding to these kernels. 
Recall that E = R” X (0,0). For a function f(z,t) defined on E let 


(2.4) ad [°F kele—6 ta) (61) déd 
and 
(2.5) fd | Sera (67) dtr 


Note that fer(z,t)=fe(z,t) EST. Also note that f(z,i)—=0 if tS. 
We now state a simple but convenient fact. 


Lemma 1. The function ker is in Lı(E). 


Proof. By (2.1) and III 
SG f ker(2,t)| dedi f° ("| (2, 4)| deat 


T 
— f Zf ale) |ae 
e T Re 
< clog aA Q. E. D. 
€ 
As a result of this lemma we have 


THEOREM 1. Leel<p<w and let fE L (E). Then fer(z,t) exists 
as an absolutely convergent integral almost everywhere in E and fer E€ L,(E). 
Also, fe(z,t) exists as an absolutely convergent integral almost everywhere 
in E and is locally in Lp. 


Proof. By W. H. Young’s inequality ([6], p. 37) and Lemma 1 the 
assertions for fer follow immediately. The assertions for f, follow from the 
fact that fer== fe for t & T, as was noted above. Q.E.D. 

Now we can state the main result of the paper: f.€ L (E) for all «>O, 
| felo S 4p | f lp where A, is a positive constant depending only on ‘k, n, 
and p, and || ||, is the norm in L,(E). Also, fe converges in L,(E) as «0. 
The proof of this result will be completed in Sections 5 and 6. 


3. The L, theory. As in the argument presented in [1] it is first 
necessary to derive the result || fella c || f lls, which proceeds very naturally 
via Fourier transform techniques. If a function F(z,t) is defined on F, 
we shall imagine it to be extended to a function defined on R**!, identically 
zero for t+ 0. Then we define the Fourier transform 
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Bat) = f° expli(e-é+ te) PG 1) Hdr 
Lemma 2. For all (a,t)€ B™, | kar(2,t)| Se. 


Proof. By definition of ker and by (2.1): 


Bra) EL a(expli(g(s)a-e+ tr) de 


(3.1) ER 
~ =f" Samoa, 


where © is the (n-dimensional) Fourier transform of Q. Let y€ R”. 
By III i 


lâ =l RRIOE Tr 
=| RE Lexp (#6: 9) — 1] 
Sf ial lev las 


Sely|. 


This is a useful estimate for small | y|. For large |y| and any ze R» 


A(y) = f (Eep (ity) dé 


(3.2) 

| = f OEH aep liy + iy) db. 
Thus 

(3.3) ap | O(E + DEN; 


subtracting (3.8) from (3.2), 
B(y)[1—exp(—is-y)] =f LOE — aE 2) exp (ie: y) dé. 
j EA 
Thus, choosing g= m PI 


alas J 196 —attr Fpla. 


By Vit 
2läy)]=zely|s 
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an estimate useful for large |y|. .Combining this with the estimate for 
small | |, 


(3.4) | 9(y)| Semin(|y|, EIDE 


Utilizing the estimate (3.4) in (8.1), it follows that for 20 


\artanlso ft min(6(r)| 21, solaj) 


(8.5) =c |z] duya 
i l ADS T 


c 1 
T ——d 
+ |z De le) 
It follows from IV that l 


f e(r) 
Bel T ar Tgp 


and 
f Seele: 
sula tlr) T 
Therefore (3.5) implies 
lald Seleta]. 


if 240. If c==0, then ker(0, t) =0, by II. Q. E. D. 
An immediate consequence of this lemma is 


Teeorem 2. Let fe L,(#). Then for al e>0, f€ La(E), and 
lfe la & € | F la- 


Proof. Since fer i is the convolution of kur and f, it follows that almost 
everywhere far = kerf, so that |far(z,t)| < c | F(z, t)| by Lemma 2. There- 
fore, [ferlsSclfls Since |P la— (2m) Di | f |a and likewise for fam, 
we have | ferla 5 c |f la or, 


elf = f” f Iert) |? deat 
(3.6) = f f era)? deat 


-f | fe(e, t) |? dedt, 
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since f, and fer are equal for EST (cf. (2.3)). As (8.6) is valid for all 
T>0, we obtain c? | f |? = |] fe la? Q. E. D. 


Egsample. It is of interest to compute the Fourier transform of the kernel 
k of Section 1, associated with a parabolic differential equation. According 


1 z 
to (1.2), k(z,t) um (im) where 


O(a) = (21) fy)" exp[P (y) Jexp (is: y)dy, 
which is the Fourier transform of the function (2r)-*(iz)rexp[P(z)]. 
According to the inversion theorem for Fourier transforms, 
See NW (rer), 
or, 
B(x) = (— iz) exp[P (—2)] = (ie)? exp[P(2)]. 
Therefore, by (3.1) 


Aa T ettr ` 
keer (x,t) == Í, Se (iert/m)e exp [P (rme) | dr 


T 
= (iz)? f exp[itr +P (2) dr, 
e 

since pr-+- "+pn=m and P is homogeneous of degree m. Thus, 

Mi iz)? . f 

Ba) = Pl +P (@)) 7] —expl it + P(@))d}. 
Since P (x) has negative real part, k,n tends to a limit k as «> 0, T —>%, and 
— (a)? _ — (img)? 
#IP(e) i+ P(E)" 
Thus, k is a bounded rational function of a,:--+,2,,t, and satisfies the 
homogeneity relation 


(3.7) k(z,t) — 


k(a!mz, at) —k(z, t), a>0. 


4. A method of partitioning space. The proof of the main theorem, 
given in Section 5, requires a fine partition of space into cells which are not 
cubes, but whose dimensions are closely related to the function ¢. The word 
“cell” shall always mean a set of the form 


{ (2, #) | oo SaSaP+r, i—1,' "yn; u stsh4+s} 
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for positive r, s and any numbers 2,°,- - -,2,°,t,. Such a cell will be said 
to have dimensions r, s. We wish to obtain finer and finer partitions in which 
the ratio #(s)/r remains bounded above and below by positive constants. 
A procedure for obtaining such partitions will now be described. 

Suppose that R"*! is partitioned into non-overlapping cells of dimensions 
¢(a), a. As the first step in the subdivision process, divide each cell in half 
in the t-direction, and let 


kı =— [$ (a) /$ (27a) J, 
where for any positive number b, [b] is the largest integer not greater than b. 
Now divide each of the remaining sides of each cell into k, equal intervals 
(each of length kı's(a)). Thus, each of the original cells of dimensions 
(a), a is divided into 2h," new cells of dimensions k,*¢(a), 27a. Note that 


since ¢ is non-decreasing, k, = 1 and the process is well-defined. 
In the same fashion, let 


ka = [hea (a) /p (2*a)] 


and let each cell of dimensions k,1¢(a), 2ta be divided into 2k,” new cells 
of dimensions k,*k2"¢(a@),27a. We continue this process by induction, 
letting 
(4.1) Key = [k > -krah (a)/$(2°%a) ] 5 
each cell of dimensions kıt- - -kp.'d(a), 27a is divided into 2k,” new 
cells of dimensions k: > -ky+¢(a), 27a. 
To see that this process is well defined, we must show that ky, is positive, 
assuminug kj221,1=1,---,r. But 
kr hey *p (a) /p(2 a) = kyt {kr + krah (a) /p (2a) } 
(2a) /p (277a) 
= ky? [k e.’ kye (a) /$(2%a) ] 
`p (27a) /p (Ra) 
= p (27a) /p(2" 7a) Z1, 
so that kya == [kt - ky 46 (a)/6(27% 4a) ] 21. Note also that 
(4.2) krè- ky *h(a)/p(2%a) =k {krt > + heya th (a) /p (27a) } 
<b [kr + yah (a) /$ (27a)] + 1} 
= ky? (ky + 1) = 2. 


But the expression on the left in (4.2) is just r/d(s) for a cell of dimensions 


450 B. FRANK JONES, JR. 


r, s, where r= k: - -k,1¢(a), s==2-%a. Therefore, any cell constructed 
in the process has dimensions r, s satisfying ` 
<T 
(3) ur 
Finally, a bound is needed on k, By (4.1) (with v replaced by-v + 1) 
and (4.2) kmi [26(2%a)/d(2" 2) ]. Therefore, V implies kya S [2c] 
sc. Thus, k, is bounded by a constant depending only on the kernel k(x, t), - 
and independent of a, the length in the ¢-direction of the original cells. 
Before proceeding further, the notion of rearrangement of a function 
must be considered. We shall use the notation of [1]. If f€ Lp(E), let 
f* (a) be a non-increasing function for 0<A<o which is ame: 
with |f|. Also let 


Bila): _: KOLS 0<A<o. 
Let 8’(A) be a function inverse to the non-increasing function £y. For details 
of the properties of these functions, see [1], pp. 91-93. We now present a 
direct analog of Lemma 1 of Chapter I of [1]. 


Let |@| stand for the Lebesgue measure of a measurable pleat a 
of Re, 


Lemma 3. Let fEL (E) and let n>0. Then there is a sequence of 
non-overlapping cells I! such that 


(1) if I? has dimensions r, 8, then is 
@) asip file; 

(8) |fl Sq ae. outside Dy= UPS 
(4) [Da] S8 (n); 

9 a<iml"f tflson 


Proof. One of the properties of 8,(A) is that lim 6;(A) ==0. Therefore, 
Xo 


Br(A) <x for sufficiently large A. Now partition R=! into cells of dimen- 
sions (a), a, such that ẹ(a)"a =à. Over any such cell I 


ins 


ef SIP WR) 
= B(6(a)*0) SBO) <n, 
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-Now partition these cells as described above into cells of dimensions kẹ (a), 
2-a, and select for the sequence {I} those cells over which the average of 
|f | is at least n. Next partition the remaining cells into cells of dimensions 
ki ky *¢ (a), 2-a, selecting for the sequence {I7} those where the average of 
|f| is at least »; etc. Then the left inequality of (2) is obviously satisfied. 
Since each I} is contained in a cell Z coming from the previous partition, 
and since it was proved above that k, Sc, |I|Sc|I/|; then 


Inf llselZf lflso 
I I 


proving the right inequality of (2). The relation (1) is an immediate 
consequence of (4.3). ` 

Next, any point outside D, belongs to arbitrarily small cells for which 
- the average |f | is less than y. Therefore, |f |<» almost everywhere outside 
Dy, as a result of the existence of the derivative of the indefinite integral of 
° |f| almost everywhere. The derivative of the indefinite integral of |f| is 
taken with respect to nets formed by the cells of our partition. Although 
these.cells do not have a parameter of regularity, the result that the above 
~ derivative is equal to |f| a.e. is still valid (cf. [5], pp.. 144-160). 

The remaining assertions of the lemma now follow exactly as in [1], 
pp. 92- 93. : Q. E.D. 


5. The main lemma, We shall now establish the a of ER 2 
of Chapter I of [1]. Having this lemma, the fact that the transformation 
f> fs represents a bounded mapping of Lp into Lọ is an almost immediate 
corollary,.and.the proof is no different from that given in [1]. However, 
the proof of the foHowing lemma is quite a bit more complicated than its 
correspondent in [1]. 


Lemma 4. Let f¢ L, (E) for some p, 1S pS2, and let 


By —{(a, t)| | fe(2, #)| > m}, > 0. 
Let ö 
| IflAn—min(|f|m). 
Then 
| By] Sort ff] An)*dedt + Ba). 


Proof. We use the construction of cells I! guaranteed by Lemma 3. 
Let e, 7 be fixed positive numbers. Define 
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| i 8 f; (z, t) € i, 
(5.1) h(a, t) = 2 ` 
f(z, t), (z, t) f Dy U P, 


and let g=f—h. Then 


u g=0, 
(5.2) 
g=0 outside Dy. 


If E, is the set of (x,t) where |he(z,t)| Z 4y and #, is the set where 
| ge(@,t)| Zn, then clearly 2, C E, U Ea, since fe—ge+h. (Clearly, 
both g and A are in L (E), and ge he exist a.e. by Theorem 1.) 

Note that 


Ja anf etf 
ste f J PHPD IEH] >a | 
so that |f| An isin Z,(#). Outside Dy, |f| =» a.e. by Lemma 3, so that 
lä] = |f] An ae. outside Dy by (8.1). In Dy |A| SIPE S IFIS 
by Lemma 3. Thus, i 
6a f ar-f, APES PESADES UAD, 


and h€L,(H). Therefore Theorem 2 implies that Í. AET Í |h |3. 
E E 


Thus, cf hPL | he |? = 4y? | E, |, and so by (5.3) and Lemma 3(4) 
By 


(5. 4) Also”) CETA a)? eBt C). 


As | E| S | E, | + | E3 |, it remains to prove (5.4) with E, replaced by Ea. 
First, we need to enlarge the cell Ij. Suppose that I? has center (=, t/) 
and dimensions r/, 8’: thus 


(5.5) I = {(2,t)| | — A| Sr, |t— H] S}. 
Then define the cylinder 


(5.6) i= {(2,t)| |z— zi |S (Vn/2+1)r, |i— t| Ss). 
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Clearly FC and | Ml Sel E]. Let Dy—L 3; then Dy C Dy and 
1 
| Dy|Se| Dy. l 
Our main task will be to establish the inequality 


(5.1) Saale f, gle, it 


Suppose for the moment that (5.7) has been proved. Then, since 


f =f fis Sith 


< < š 
„Isis, drl+lmd=2f, Ifl; 
therefore, (5.7) implies that 


63), lalse2 f,loisez2f, i= f If 
By Lemma 3(5), (5.8) implies 


it follows that 


(5.9) S, 191E] Dl. 
Now 

[E| S] D| +]82— 27| 
ve <¢|Dy|+|Bs—Dr]. 
But on Es, | ge| = 4y. Therefore, by (5.9) 


cy | Dy | 2 J gd? 1B — On|, 


so that (5.10) implies | #,|Sc¢|D,|+c|D,|Sc|D,|. By Lemma 3(4), 
| Es | & c8! (n), and, combining this inequality with (5.4), Lemma 4 is proved. 
Thus, it is sufficient to establish (5.7). 

Since g € L (E), ge(z,t) exists a.e. by Theorem 1. Also, since g==0 
outside Dy, 


a „t =R ke — é i—r IT dr 
8:(2, t) J, (z )g (é, 7) dé 
- If k(e—&t—n)9 (6r) ddr. 
7 1 
Let 
(5.11) if b.(e—€,t—r)9 (67) dédr, 
2 
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so that =D Gi, a.e. Then, since E — Dy C E — di, 
: i 


Jz @.|=< J, Gel. 
Sn IER Sen! Se a el 
Therefore, to establish (5.7) it suffices to show that ` 


(5.12) MACAE N: 


Since (5.7) implies the validity of the lemma, it is seen that the lemma will 
be proved if (5.12) is proved. Up to this point the proof of the lemma has 
been exactly as in [1], but the proof of (5.12), to be given now, is con- 
siderably different. 

The analysis is different depending on the relation between s/ and e. 
For simplicity we will delete the superscript j from I’, 9, ri, sf, and Gy, 


Case 1. sS 2e. In this case 


5.13 | f : = |, a, 
(5.18) AOS NORET 
where 
J, = | Gel; Ja = | Gal. 
tti +e tatlı+2e 


Now (&r) EIS |r—#|S $s Se so that if t= t +2%e, then 


t—r Z Y — r + Re Z ep Re 
Therefore, 


n= S. f Ka é t—r)g (é r) dédr | dedt. 


Since Í g= 0 by (5.2), 
I 


n= f a S pe Set kaea, t— #) | ddr | dedi 
(5.14) 
Sf 76196 )l ddr, 


where 


(5.15) Ja(é,7) = fS 1e—6t—)— tle — s, t—t)] dadı. 


Next, Ja & Ja 4 Js, where 


Ter) =f" S]a it) t(s, t—r)]| deat, 
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ne = fT Se -ntn Heat d)| deat 
By I, l l 


EI Se m CI en 5) 79 (gay) a 


Making the change of variable y == 





the integral for J, becomes 











re D 
SS tÉ ha 
By VIO and IV, 
Her sof” lal a c|é— 4 a 
<, lé—7] 
COE 


Now ti—r+ 2 2c2=4s, as shown above, and |é— |< "r (all for 
(& 7) € I), so that 


Jläör)Sc——=S ’ 
Einen} 
by V. Finally, Lemma 3(1) implies that J,(&r) Sc. Next we show also 
that Js(&r)=c. This will imply that Js(&,r) Sc, which by (5.14) implies 


lS ; 
Sef lg| 
Now by II, 





Co = a E (en 





re) (a iy) | deat 


=J.(§,r) +Jı(&r), 


where 


26 S So er l. —2 (Gey) a 
ES Im | Er ae! 


Je (Ey) lät. 





14 
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In the first of these two integrals the change of variable res shall 
be introduced, and in the second er er) Thus, 


ESS, | 


én) = Sf, er Fu fol. 


Now for (&r)EIandtZU-+2%e, we have | 





hence, 





Therefore it follows from V that the ratio i 2 is bounded above and 


below by positive constants depending only on the function &. Therefore, 
VIII implies 




















_of set —#) 
6.10) f |a(y)—a Fr By )la dy < o| = =t 
(Note that such an inequality is trivial if -= a, is not close to 1, and is 
bounded away from zero.) But by VI, 
p(t — r=#] 
(5.17) SG) ET a" 
Combining (5.16) and (5.17), 
2 y 
Jalg, 7) = cf. | tT? | (t—7) (—#) di 
i dt 
(5. 18) s c | tT—Ë l Arne cr (¢—#) 
=c s == ¢, 
ee == = 
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o(t— i)” t—t o(t—¥) t—é 
| d(t—r)r t—r vst ~~ I+] t—r 
t— tT— t 
Rn en 
a 
t—r 


Therefore, this inequality and IHI imply 


s Ir —#] 
Tie sf gan ts 


by (5.18). Combining these estimates, J,(&7) Sc and so 
(8.19) n=f, | g(&r)| dedr. 
Next, we estimate J+. Fortunately, this estimate is quite simple. Indeed, 


titte i 
ha f G,(2, t) | dedt 
T je 


s S ff, met || 964) déd dad 


ut l 
tite t+26 
J f Beat) dedt— f f |@—Gt—2)| deat 
0 Re TH Rea ; 
t54+2¢ dt 
Se Fag] WON Ae 


by (2.1), and the latter integral is bounded by clog Stes <S clog #+— got Be + a: 


<clog3. Thus, ILe f | g(ér)| déd. 


Combining this estimate with (5.19) and using (5.13) gives 


JS, [@lsef lal. 


Consequently, (5.12) has been established for all cells F satisfying s/< 2e. 
We now treat the other cells. 


Case 2. s>Re Using again the fact that f g=0 (see (5.2)), we 
have by definition of Ge (see (5.11)) 
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Sia! | Í, f, kl — &t—r)g(&,r)dedr | dzdt 
ard If ke(a— é, t— 1) g (é, r)dédr | dedt 
B-3 I 


taila 


(5.20) $ | f [%e(a—ét—+r) —he(z — si, t—t)] 
a 
: g(é r) dédr | axdt 
S (Wer) +5067] | g6 2)| der, 
where 
en f, lke(2— £ t—7)| ded, 
ah a 
Ilé) = f Bla é t— 7) — bea —ai, t—t) | dedt. 
Sie 
The integral Js is easily treated. Since ke(2—,t—1) =0 fort <r +46 
and since (£7) €IJ>r+eSl+tste<ctt+s, 


tits 
Js (& die f Me | x 7 = t) | doat 


we have used the definition of & ((5.6)). For (&7)¢€I, |&—si] S 4r 
according to (5.5), so that |é—a/|<4Vnr. Therefore, by the triangle 
inequality, | z— z! | > (Vn/2+1)r> |e—£|>r. Hence, 


ti+s 
TOOS N f „a5 1) det 


"Hf Joola 
ee A 


taking (2.1) into account. But then IX implies 





di 


t—r 





Mensen 
=e f TUO 


33 
ef Wert, 


since for (ér) €I, #—r& $s. As g(t) is nondecreasing, and by IV, V, 
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48 
Kenner [PO a 


S cp (8) S c($(s)/r)*. 


Thus, Lemma 3(1) implies Js (é r) Se. 
Finally, we show ‘that J,(&,r) Sc. Once this is established, (5.20) will 


imply f | alse f |g(&r)|d£dr. Therefore, (5.12) will have been 


established for all cells I’ satisfying # > 2e. As (5.12) was proved for s/< 2e 
under the first case, (5.12), and hence (5.7), will have been completely 
proved. As mentioned above, the proof of the lemma will then have been 
completed. 


Now 
(5.21) séns f” [rest —k(e—a), 14) | dedi, 


since t—r = (t— t) 4 (4—r) 2s—4fs—4ds>ec. (Recall that (6,7) €I 
>|#—r|<}s) The bound for J,(&,r) in (5.21) is quite similar to the 
expression (5.15) for J,(é,r), except that 2e is replaced by s. The fact that 
Jo(é,7) <Sc is proved in exactly the same way as the estimate J,(&,r) Sc is 
derived, except that the proof for J,(&,r) is somewhat simpler at some stages. 
Thus, Ja (ér) Sc. By the remarks made in the previous paragraph, Lemma 
4 has now been established. Q. E. D. 


6. Convergence in L,. As mentioned in the first few lines of Section 
5, the following theorem can now be established. 


THEOREM 3. Let l<p<o, and let fe L (E). Then fẹ defined by 


fe(2) = f hele —y)F(u) ay, 


belongs to L,(E), and there exists a constant A,, N only on p and 
the kernel k, such that 


I fe lo S 4; I File 


The proof is exactly the same as given in [1], pp. 97-99, using Lemma 4. 
Finally, we establish the existence of lim f. in the space Ly. 
e0 


THEOREM 4. Let1<p<%, and let FEL (E). Then f, converges in 
L (E) as e—>0. 
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Proof. Suppose F (e,t) is continuously differentiable for all (x,t) € R", 
has compact support, and vanishes for ‘0. Then 


RES J. 3 Jf ble 8t—1) (67) dear 
(6.1) = Í PEN Í, kat) R(&r)dtdr 


max(0, t-e) ` 
Se f See: [F (é, r) —F (z, t) ]dédr, 


by III. By the properties of F, | F(&r) —F(z,t)|<M[|2=—£|+|t—r|] 
for some constant M. Thus, if 0 < e< 8, 


max(0, t-e) /* 
| Fe(a, t) — Falz, t)| =] oe Jre-5:—9 
(6.2) | - [F(é7) — FG, t) ]dédr | 


è 
suf’ f |e@—& to) []e—€| + trld 





uf, a Si a(y)| [| ¢¢—7)y | + t—r]dy, 


by (2.1). By II, IV, 


Ida, Dar S yila) 


t 
+ fa f idy 
zu. f 2 do +. Mes 
= Mc$(8) + Mod. 


Therefore F.(z,t) converges as «—>0, uniformly for ze R", t=0. Denote 
the limit function by F,(z,t). By (6.1) and (2.2) F.(z, t) =F, (x,t) for 
«<1 and for sufficiently large ¢ depending on the support of F. Thus, if 
F(z,t) vanishes for t = T, and if e <1, 


T+1 
Imre f SF!) Pola, t)? deat 


T+ TH 
-f f +f f | F.—F, |? dadt, 
o leisA . 9 [al>A 


for any positive A. Since F. converges uniformly to Fe, 
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PHL 5 
gee. g E Tepes a f f F,—F, |? dadt. 
(6.8) lim sup | Fe—Fo fy nsup J, ee ol 


Letting e—> 0 in (6.2) and then replacing 8 by e in the resulting expression 
give 


ECOS ACIN J" f ee—bt—*) 
(6.4) [F (67) —F (2,1) déde| 
$= 
Sf" S,#e-5t-n IFE r) F(A) dan. 


Now suppose that F(z, t) ==0 for |z| =B. Then for |z| > A> 2B, (6.4) 
becomes 


Font) — Fels" f ltet) || FG) | dear 


t 
Smar] fi fl Qt) | duds 


t dr 
== max | F f f Q d 
A RT 
by (2.1). Therefore, if y == max | F |, 


(6.5) IRRE, low)lay. 


Now for |z| > A> 2B, |t«—¢(r)y| <B implies 





$(7)|y|2|2|—|e—4(r)y| >|2|—B>|2|—4]2|—4]2|, 
so that (6.5) implies 
€ dr 
F(a, t) —F, (a, t)| = — Q dy, A. 
LOCH RDE fo Ff IOIL ae 
Taking IX and IV into account, we have for |x| > A, 


EICHE Fela, t)| STE BELCHTOVENIT. 


Sy jej (Dar 
S yop(e)* | z |. 


Therefore, the integral in (6.3) may be estimated as follows: 
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SS IPP raed s (Tpl f 12de 
0 lel>4 lal>A 
S (T+ 1) yop (A, 
as p> 1. Thus, this integral tends to zero as «> 0, so that (6.3) implies 
lim | Fe—Fo |p = 0 


e>0 
for all functions F of the class considered. 
Since the transformations mappings f into f, are uniformly bounded 
by Theorem 3, and since fe converges for f in a dense subset of L,(E), it 
follows immediately that fẹ converges for all f€ L,(E). Q. E. D. 


7. Remarks. A few remarks on the special case of Section 1 are in 
order. In the first place, the kernel k has a Fourier transform k which is a 
bounded rational function of Tı, ` `, Tn t, as shown at the end of Section 3; 
see in particular (3.7). Our results show that ie is a multiplier in Z,(E) 
in the sense that if fe La(E) N L£,(#), then the inverse Fourier transform 
fo of kf is also in Z,(E), and | = Ap I f lp- 

There are several theorems in the paper of Calderón and Zygmund [1] 
which are consequences of their Lemma 2 which corresponds to our Lemma 4, 
and analogs of these theorems could also have been stated in the present paper. 
However, we have not been able to obtain several very important results 
found in [1]. For example, it would be fruitful to know that fe converges 
pointwise a.e. as well as in mean. Also, one would like to know that the 
function 


f(z, t) = BUD | fe(z, t) | 
e>0 


is in Lp(E) whenever f is and that | Fo lp 4; I f Il. 
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ERRATA. 


Errata to F. J. Hahn, “Affine transformations of compact Abelian 
groups,” American Journal of Mathematics, vol. 85 (1963), pp. 428-446. - 

It was pointed out to the author by W. Parry that Lemma 4 on page 430 
is incorrect as it stands. However if we make the assumption that X has 
no elements of finite order the lemma is correct. The known proofs of this 
fact are radically different from the approach used in the paper. The proof 
I give here is due to S. Kakutani. With his permission I give it rather 
than my original correction because of its elegance and ingenuity. 

On p. 480 replace Lemma 4 and ita proof by the following: 


Lemma 4. Let S= (zo A) E€ A(X) and suppose S is ergodic. It 
follows that tf E is a character of X and if there is a positive integer n such 
that Vg"é==€& then & is of finite order. 


Proof. We suppose é is a character of X and Va” = ¢ for some positive 
integer n. We may assume n is the smallest such integer. To show that £ 
is of finite order it suffices to show that the range of £ is finite. The idea of 
the proof is to define a particular continuous homomorphism y: Z> Tr 
(T™ is the m dimensional torus).and to let K be the closed subgroup y(X). 
We let u and @ be normalized Haar measure on X and K respectively. We 
then define a continuous, one to one map o: K>K such that y8 = oy, more- 
over we show that o* = identity. We use the ergodicity of S to show that 
a is ergodic. Since ø is also periodic it follows that K is finite. We use this 
fact to show ¢ is of finite order. We now fill in the details of the argument. 

Since Vgf== (ro) Vat we see that Va” — ¢ implies Va" =é. There is 
a smallest positive integer m such that Va"é—é and moreover n= md where 
d is a positive integer. We observe Vg™{—cé consequently ctf — Vgmdt 
= Vg" = ¢ and thus cl==1. For later reference we note 


Com E (To + Ato t+ + Amis). 


We define y: X>T” by y(z) = (&(x), (Az), €(A7z),* + +, €(A™*2)). We 
define o first on T” and then restrict it to K. We let 


o{v,, Va", Um) = (€(Zo) V2) &(Az) vs, a E(A"725) Um, &(A™ 25) 01) i 
1 The author was partially supported by NSF G-25222. 
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Since c = (a) + AT +: - -+A™2z,) and cf = 1 we have o (04, Ve, © °, Um) | 
= (CVa OVa,’ °°, CUm) and o*==o™ = identity. Thus o is periodic. We 
compute easily that yS—oy soo: K>K. 

We now wish to show that o: K>K is measure preserving. For 
each Borel set ECK define 6(#)—yp(y"(#)). We see that 6(K) =1, 
#(vE)=#(E) and if # is open then 6(#) >0. This shows that 6 is Haar 
measure on K. The o invariance of 6 follows from 


(oR) = p(y*oB) = n(SYB) = (9E) = 6(B). 


If 6(E) >0 we see that »(y*#) >0 and thus the ergodicity of (X, 8, a) 
implies that (K,c,9) is ergodic. Thus o is simultaneously ergodic and 
periodic with period n. For each point ke K we must have 6(k) >0. Tf this 
were not true then there would be an open set U such that 0 < 0(U) <1/2n. 


Let W= U oU. We see that 0<0(W) S4 and W is o invariant. This 
cannot be Seas eis ergodic. The same type agrument shows k€ K implies 
6(k)=1/n. Thus K is finite. Since 

Km {(E(2), €(42),- > +,€(A™z)): sE X} 
it follows that ¢ has finite range and is thus of finite order. 


Also on page 430 following the last line insert the following sentence in 
the hypothesis of Theorem 4: Moreover suppose that X has no elements of 
finite order. 

In connection with this error I remark that Lemma 4 and Theorem 4 
are not used in Section 3. Sections 2, 4 and 5 concern themselves only 
with the case where X is a torus so X has no elements of finite order. Thus 
the corrections have no effect on the remainder of the paper. 


YALE UNIVERSITY. 


ADDENDUM. 





Addendum to Morris Newman, “Normal congruence subgroups of the 
modular group,” American Journal of Mathematics, vol. 85 (1963), pp. 419- 
427, 


Addendum. In the proof of Theorem 2, the argument at the end of page 
426 requires a special dieission in the case m= pq, p, q distinct primes. 
Choosing d == p, d= gq we find that 
(T(n): P(np)) — (Tin): T(ng)) 


which implies that p—g°, P—g(—1), p(p?—1)—¢ or p(p*—1) 
= q(q?—1). None of these cases is possible and the proof is concluded as 
in the paper. 
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' A NEW GROUP ALGEBRA FOR LOCALLY COMPACT GROUPS. 


By JOHN ERNEST. 


When an abstract group is represented by linear transformations on & 
vector space, the group of transformations generates an algebra. In the case 
of finite dimensional representätions of a finite.group, the algebra consists of 
linear combinations of elements in the range of the representation. It is 
therefore natural to associate an algebra with the abstract group in a similar 
way be defining the group algebra. The representation theory of the group 
is then. equivalent to the representation theory of an algebra. 

Unfortunately there appears to be no single natural analogue of the con- 
cept of group algebra, to be used when studying infinite dimensional represen- 
tations of topological groups. In the case of unitary representations of locally 
compact groups, the most popular choice for the role of “group algebra” has 
been L'(@). The crucial sense in which L?(@) generalizes the concept of the 
group algebra of a finite group is that the strongly continuous unitary repre- 
sentation theory of G is equivalent to the no-where trivial a 
theory of L’(@). 

One sense in which the analogue’ breaks down is that Z1(G) is not the 
same “kind” of algebra as that associated with the range of a representation. 
This deficiency has been ameliorated by the following procedure. If we 
renorm L*(G@) by defining || f loo — Sup | T; |, where the supremum is taken 


over all no-where trivial reelle T of L!(@), and then complete 
1+(@) relative to this norm, we obtain a C*-algebra, C*(G), which is called 
the group C*-algebra. Once again we have that the strongly continuous 
unitary representation theory of @ is equivalent to the no-where trivial *- 
representation theory of C*(@). (Cf. [6] and [7].) Unforunately the sense 
in which L*(G) and C*(G@) are generated by the group G is not analogous to 
the group algebra of a finite group. Except when @ is discrete, L*(G@) and 
OTAG) do not even contain the group. 

- Another candidate for the role of group algebra, which does contain the 
group, is the measure group algebra M(@) of all complex valued finite regular 
measures on G, where multiplication is convolution. A group element x 
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appears in M (G) as a measure pe defined, for any subset B of G, by ps(B) ==0 
if cé B and p(B) —1 it sEB. The study of M(@) for non-abelian locally 
compact groups has been largely abortive, since the crucial requirement for a 
group algebra breaks down. The representation theories of Œ and M(@) are 
not equivalent. The norm topology of M(G) induces the discrete topology 
on G. Thus while every *-representation of M(G) gives rise, by restriction, 
to a representation of Œ by unitary operators, this representation need not be 
strongly continuous relative to the original topology of G. ` 

Unlike the finite dimensional case, there is more than one way to associate 
an algebra with the range of an infinite dimensional unitary representation L 
of a locally compact group G. Experience indicates that the most useful 
algebra to consider is the weakly closed *-algebra of operators Q (L), generated 
by the range of the representation L. Since such a von Neumann algebra can 
be associated with every representation, one asks, by analogy with the group 
algebra of a finite group, whether such an algebra can be associated with the 
original locally compact group? From this point of view, the “flaw” in. 
M(G) is that there is no other topology, in addition to the, norm topology. 
We shall see later that this is where the topology of G was lost. 

The purpose of this paper is to introduce another candidate for the title 
“group algebra” of a locally compact group. This algebra, which we call 
the big group algebra and which we denote @ (G), is defined at the beginning 
of Section 1. ((G) is a C*-algebra in which analogues of the operator 
topologies are defined. These are called the weak, strong, o-weak and o-strong 
topologies of @ (G). The adjective “big” derives from the fact that each of 
the previously mentioned candidates, L(G), C*(@), and M(@), are canonically 
embedded, one-to-one and norm decreasing, in @(G@). These classical group 
algebras are dense in @ (G), relative to each of the topologies weak, o-weak, 
strong and o-strong. The group @ is canonically embedded in G (G) as a 
group of unitary elements. The topology of G is obtained as the restriction 
- to @ of any one of the topologies weak, o-weak, strong, and o-strong of A (G). 
G is discrete in the norm topology of A (Q). The group G generates Q (G) 
in the sense that the subalgebra of finite linear combinations of elements of 
G, is dense in @ (G), relative to any one of the four topologies, weak, o-weak, 
strong and o-strong. l 

The algebra @ (G) may be represented isomorphically as a von Neumann 
algebra acting on an (in general) non-separable Hilbert space. This iso- 
morphic representation of @ (G) as a von Neumann algebra is a homeomor- 
phism relative to the o-weak and'o-strong topologies. 

The algebra G (G) may be identified, as a Banach space, with the second 


LOCALLY COMPACT GROUPS. 469 


conjugate space of the group C*-algebra, C*(@). Under this.identification, 
the weak topology of @(G@) corresponds to the weak*-topology of the second 
conjugate space of C*(G). 

Finally, the separable strongly continuous unitary representation theory of 
G is completely equivalent to the separable normal *-representation theory of 
A(G). Every separable strongly continuous unitary representation L of G 
may be extended to a normal *-representation Z’ of @(@) onto G(L). This 
extension is unique. Indeed the restriction of a separable normal *-represen- 
tation T of Q (G), to the group G, gives a strongly continuous unitary repre- 
sentation L of G such that T =F. 

: This theory had its beginnings when the author was an NSF postdoctoral 
fellow in residence at the Institute for Advanced Study. In addition to 
expressing his gratitude to his home institution, the University of Rochester, 
the author wishes to thank the Crandall Library of Glens Falls, New York, 
for the use of their facilities during a portion of this research. This work 
was supported in part by grants from the National ‘Science Foundation, 
NSF-G23799 and NSF-GP1620. 


1. Definition of the big group algebra. Let @ denote a separable locally 
compact group. Let 9/ denote an infinite dimensional separable complex 
Hilbert space. Let G¢ denote the collection of strongly continuous unitary 
representations of G, with representation space Y. Let @ (G) denote the set 
of all maps J on @°, whose values are ODER on the space &, satisfying the 
following two properties. 


(1) Sup IL): Le G9} < 4-00 


(2) IHM, N€ Gand if U is an isometric mapping of the representation 
space of M® N onto 9, then 


J(U(H ® N)U*) =U (J (M) @I(N))U*. 
The elements of @(G) will be called options. We define a *-algebra . 


structure for @(@) as follows. If J, K are options in (G) and a, ß are 
complex numbers, then 


(i) J] =Sup{| J(Z) |: Le @} 

Gi) (J 4+ BK)(L) =aJ (L) + BK(L), for all L in & 
(ii) (JK)(L) =J(L): K(L), for all L in @ 

(iv) J*(L) = (J(L))*, for all L in @°. 
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Definition 1.1. The collection of options @(G), with this *-algebra 
structure, will be called the big group algebra. 


TEOREM 1.2. A(G) is a C*-algebra. 


Proof. A routine verification gives that @(G@) is closed under the 
*-algebra operations. It is easy to verify that if a, 8 are complex numbers, 
and J and K are in A(G), then | / HK I<|a| 7 IH BIT KIT, 
LJENE IIINE N, 191-1 and 747 | =| 1%. TE (i) is a Cauchy 
sequence in @ (G), then, for each L in G°, {J;(L)} is a Cauchy sequence of 
operators which converges to an operator. J (L). A simple verification now 
gives that the map J defined in this way is an element of @ (G) and that 
the sequence {J,} converges to J. 


Definition 1.3. The weak topology of A (G) is defined to be the smallest 
topology such that the functions J> (J(ZL)y,¢) are continuous, for all L 
in @ and y, @ in &. 

A neighborhood system for a point J in Q (G) consists of the collection 
of sets of the form 


UG elit LP ba", Yn bry” * 15 Gn) 
={K: K€ A(G) and |((J (Lt) — KL) jy p) |S Li= 1 --,n} 
where Lt is in @° and yı and q are in Y, fort==1,---,n. 
The weak topology is Hausdorff and locally convex. . The linear operations 
in @(@) are weakly continuous and in addition, if K is a fixed element of 


A(G), the three maps J-> KJ, J>JK and J>J*, of A(G) into A(G), 
are each weakly continuous. 


2. Q(G) contains the group and the classical group algebras. In this 
section we consider the three classical group algebras, L’(@), C*(G@) and 
M(G), referred to in the introduction. We first exhibit a canonical isomorphic 
embedding of each of these group algebras into @(@). 


Definition 2.1. For each y in M(G), define # to be the operator valued 
function on @° defined by the formula 


ES (Lots 8)ar(2) 
for all L in Ge and all y, ọ in H. 
Since L!(@) may be identified with those measures in M(G) which are 
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absolutely continuous with respect to Haar measure, this defines an embedding 
of L*(G) into A(G). If fe L*(G), f is the operator valued function on @¢ 
defined by the requirement 


GEA =f Te) Lets #)de(2) 
a 
for all y, $ in Y. In this formula, » denotes Haar measure. 


TEHROREM 2.2. The map-v—>v and ff defined above is a norm 
‘decreasing isomorphism of M(@) and L(G), into A(G). The map of 
L (G) may -be extended uniquely to an isometric isomorphism of C*(@) 
into A(G). 

Proof. We first verify that y—> > is an isomorphism of M (G) into A(G). 
Suppose » is an element of M(G). The norm in M(@) is defined to be 
iv —|v»](@), where |v| is the measure on G defined by 


|v | (E) = Sup $ | (2) |, 


where the supremum is taken over all finite collections of pairwise disjoint 
Borel sets E, whose union is E. 
If f is a complex valued v-integrable function on G, then 


IS false Sap (lF): Ee). 
Tf Le @ and ye &, |y |= 1, then ,. 
iD e= GE) Ey) 
= f T Eyde) 


‚lei Sup {| (Lay, H(Z)y)|: 2E G} 
Sv] Sup {l Loy [I P(E)y l: ce G} 
Sli ey 
Hence | 5 | = Sup {| #(Z)y |: Ze Gye H, Jy | =1} S lri- 


Thus we have verified that » satisfies condition (1) in the definition of 

' A(G) and that the embedding is norm-decreasing. We leave to the reader 
‘the verification that » also satisfies condition (2) of definition 1.1. 

The reader may verify that the mapping »—>? preserves the linear struc- 

ture. We apply the Fubini theorem to show that the multiplicative structure 

is preserved. Suppose y== n * v2, where r, vı v are in M(G). Then for all 


L in G and y, ¢ in Y, 
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(v(Z)y, $) -f (Lep, p)d(v* va) (2) 
=f (Lap, p)d(v X ve) (2,9) 
GxG $ 
=f, f, TeL 4) dva(y) drs (2) 
G 


= f, (P (L) Ly, 6) dve (y) 
= (A(L)p, A (L)*$) 
— (( 9) (L)y, p). 


Thus the embedding is a homomorphism. We next show that the em- 
bedding is one-to-one. Suppose ve M(G) and v—0. Then 


GNS, Lat) dr(a) —0, 


for all L in G° and y in &. Note that every continuous positive definite 
function on G is of the form z—> (Lab, y), for some L in Ge and y in Æ. 


Hence f g(a) Gila) ==(, for all continuous positive definite functions g 


on G. Theorem 10 of [8] implies that y= 0. 

Since Z1(G) is contained, isomorphically and isometrically in M(@), 
we have also verified that Z*(G) is embedded isomorphically in Q (G). We ° 
leave to the reader the verification that the involution is preserved. l 

Tf one renorms L(G) by || flo. = Sup || T; ||, where T runs through 
all no-where trivial *-representations of L> (G) acting on &%, the embedding 
f—/f/ becomes an isometry. Indeed, each such 7 arises from some repre- 
sentation T” in G° in such a way that T; == f(T”). Hence | f jo == Sup | TI 


— Sup {|| f(7’) ||: TE Ge} =f f |]. Since @(G@) is complete the mapping 
ff can be extended uniquely to C*(@), the completion of Z!(@) under 
the norm || cs. Thus C*(G@) is embedded isomorphically and isometrically 
in A(G). 


THEOREM 2.3. The group G may be embedded in A(G) as follows. 
If z is an element of Q, define & in A(G) by £(L) == La for all L in @. 
Let & denote the image of G under the map tz. Then & ts a group of 
unitary elements of A(G). Relative to the norm topology of A(G), Ĝ ts a 
discrete group. Relative to the weak topology of O(G), G is a topological 
group isomorphic and homeomorphic to G. 
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Proof. The verification that —>2 maps @ isomorphically onto @ is 
left to the reader. The elements of Ĝ are ‘unitary since, if £ is contained in 
G, then 

(2-2*) (L) =£(L)- (L)? = LsLa* =I 


where I denotes the identity operator on #. 


We next show that & is discrete in the norm topology. Indeed we shall 
show that if z and y are two distinct points of G, then || £—y|] 21. Let R 
denote the left regular representation of G, p left invariant Haar measure 
on G, and let U denote a neighborhood of the identity e of G such that 
yU aU is empty and where 054n(U) < -+œ. Such a neighborhood can 
be found since G is locally compact and Hausdorff. Let «= („(U))# and 
define f in L?(@) by f—axXxy, where Xay is the characteristic function of 
the set zU. Then 


P= f POPIO =e S dat. 
Thus || f || ==1. Let M denote an element of G° which is unitary equivalent 
to R. Then 
| €—¥ | — Sup {|| (L) —g(Z) ||: Ze G} 
= 12) II 
= | Ref — Rf | 


>[ Í, | Bef (€) — Bf (€) dad] 
= f, IEE Wlan 


Zie f aH 


The fact that G and G are homeomorphic relative to the weak topology 
follows immediately from the following lemma. 


Lemma 2.4. Let G be a locally compact group. Then the topology 
of @ is equal to the weak topology associated with the set of positive definite 
functions on G. More precisely, the given topology of G is the same as the 
smallest topology such that the positive definite functions on G are continuous. 


Proof. Let U denote a neighborhood of the identity e of the group G, 
whose closure is compact. Choose a neighborhood V of e such that V == V+ 
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and V? C U. Let xy denote the dinvactavistic function of. the set V. Define 
the function fy on G by the formula 


fo(z)— [xv (Exe (E) da(é) 


for alll zin G. The reader may oe that fo is a en definite fonction 
on G, which vanishes off of U. 

Let P denote the collection of all left translates af ineton of the 
form fy, where U is a neighborhood of the identity, with compact closure. 
According to Proposition 3, page 23 of [8], every element of ? is a linear 
combination of positive definite functions on G. Thus it is sufficient to show 
that the given topology of G is the weak topology associated with the 
collection P. 

By choosing the neighborhood U sufficiently small, it is ‚easy to veny 
that the collection P distinguishes points. Further the functions of P all 
“vanish off compact sets, and not all vanish at any one point of G. By 
‘Theorem 5G of [10], the given topology of G is the same as the weak 
topology determined by the collection of functions ?. 


3. The identification of (@(G@), as a Banach space, with the second 
conjugate space of C*(G). For notational convenience, let cf denote the 
‚group (*-algebra, C*(@). Then the conjugate of c4, denoted c4*,, is the 
normed linear space of all bounded complex linear functionals on e4.. 

We define a map of c4** into @(G@) as follows. If F is contained in 
.cA**, let # denote the element of Q (G) defined by the requirement that, 
for each L in @ and y, ¢ in &, 


(Ê (L), b) =F (fave) - 
where fry,¢ is that element of c4* defined by 


fun) È 2(€) (Ley, $)dn(€) 

VG 

for all æ in L'(@). The function fr,y,s is defined for all points in the com- 
‘pletion ef of L*(G) by continuity. (Cf. Lemma 1.4 of [6].) 


TEEOREM 3.1. The map F->F is a one-to-one linear norm decreasing 
map of cA** onto A(G). In fact, |F S| Fl S2| Pll for all Fin of**. 
‚In addition the mapping is a homeomorphism relative to the weak*-topology 
«of cA**.and the weak topology of A(G). 


Proof. We first verify that if F is an element of e4**, then F is con- 
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tained in A(G). We leave to the reader the simple verification that for each 
fixed L in @° and F in cf**, B(y,ġ) =F (fry,¢) is a bounded bilinear 
functional on X. In fact, | B(y,d)| SF lyi le] for all y, $ in &. 
Thus for each L in G° and F in c4**, F(L) is a linear operator on ¥ and 
IF) SIF], for every L in @. Thus JÊ] SIF] and Ê satisfies 
condition (1) of the definition of G (G). We leave to the reader the non- 
trivial verification that Ê satisfies condition (2) of Definition 1.1 and thus 
that F is contained in Q(G), as well as the trivial verification that the 
map F>F preserves the linear structure. 

We next proceed to show the mapping is one-to-one. Due to the corres- 
pondence between unitary representations of Œ and no-where trivial *-repre- 
sentations of cA, it follows that every positive linear form on c4 is of the 
form fry», where yE # and LEG. According to Theorem 1 of [9], these 
positive forms generate cA*. Suppose F is contained in c4** and F=0. 
Then (#(L)y;~) =F (fr yy) =0, for all Lin Ge and yin Y. Thus F=0. 

We next verify that | F | <2] Ê], for all F in e4**. . Let o4,* denote 
the positive elements of e4* and c4,” the hermitian elements of e4*. For 
each F in e4**, let 


|F lo = Sup {| F (f) | : f E 434, IF | = 1} 
and 


|F la = Sup {| F (F) |: TEEN; 
Then clearly |F l SI F b£ F I 


According to Theorem 1 of [9], each element f of c4,* may be expressed 
-uniquely in, the form f=fi—fs, where f, and f: are in e4,*. Further 
Ifl— 1+ ifl. Tt is easy to verify that this fact implies | F |p = | F Ila, 
‘for all F in cA**. 

Each f in c4* may be expressed in the form f= f, -+ ifẹ where fı, fa 
.are in cA,*. Thus 


| P l= Sap {| F (f1) +F (fe) |: fy fa € A", | fat ifa || S1) 
S Sup {| FF) + | Ff) |: fofa € A flH Ul fe | S 2} 
S2S8up {| P(A) |: he HH, fil] S1}—2 | F a. 
-Hence g 
Ir|=?2 NE la AG: fe e4,*, | f | =1} 
= 2 Sup {|(#"(L)y,¥)|: Le Gye Y, ly | =1} 
<2 Sup {| F(L)|: Le Ge} 2] F}. 
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We next verify that the mapping is onto. Let J be an element of Q (G). 
Define the complex functional $ an e4,* by $ (fr¥y)—= (J (L)y, Y), where 
L is contained in G° and y is an element of ¥. 'Ẹ may be extended to all 
of @4* by linearity, since every element of c4* is a unique linear combina- 
tion of elements of e4,*. (Cf. Theorem 1 of [9].) To show that 9 is 
linear on c4*, it is sufficient to verify that 9 is linear on c4,*. We leave 
this verification to the reader. Further 9 is bounded since, for all f in o4,*, 
ISL AOISI Tms 191S21} ERIT]. Bence $ isan 
element of c4** and J =m 3. 

The map FoF isa Hanser relative to the weak Kuala of 
cA** and the weak topology of @(G). Indeed since every element of c4* 
is a finite linear combination of elements of e4,* (cf. Theorem 1 of [9]) 
a net Fy in e4** converges to F in e4** in the weak*-topology if and only 
if Pa (fryy) = (FA(L)y,y) converges to F (fry) = (F(L)y,y), for every 
Lin @ andy in Y. Thus the'net Fy converges to F in the weak *-topology 
of cA** if and only if the net A, converges to F in the weak topology of 
a(e). 


CoRoLLARY 3.2. Bach of the group algebras L(G), C*(@) and M(G), 
is weakly dense in A(G). 


Proof. In the usual way C*(@) =c4 may be embedded in c4** by a 
canonical linear isometry, »— a’. Let e4’ denote the image of c4 under this 
embedding. Then (cf. Theorem 4, page 19 of [1]) A’ is weak* dense in 
cA**, By Theorem 2.2, ef may also be embedded isometrically in @(G). 
Let ef denote the image of c4 in d(@). We leave to the reader the simple 
verification that these embeddings commute. Thus c4’—=e4. Hence C*(G) 
is weakly dense in @(@). Since L (G) is dense in C*(G), relative to the 
norm of C*(G), we have that L!(@) is weakly dense in C*(@) and hence 
in A(G). Since L!(G) C M(G), M(G) is also weakly dense in @(@). 


Remark. The approximate identity of Z*(G@), converges weakly to the 
identity of @(@). 


. Remark. We have observed many natural embeddings and identifications 
among the objects so far considered in this paper. Thus L!(@) is embedded 
in C*(G@) and also in Af(G). G is embedded in M(@) as well as in A(G). 

I*(@), C*(@) and M(@) are all embedded in @(@). C*(@) is embedded 
in cA**, The reader may verify that all these natural embeddings commute. 
For convenience we shall therefore make certain identifications, whenever 
there is no danger of confusion. Thus, as in the statement of the previous 
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corollary, we shall consider G, L (G), C*(G) and M(G) to be subsets of 
A(G) and also, by the corespondence between c4** and @(G@), as subsets 
of cA**, This identification is summarized in the diagram below. 


a(@) 

C V 
M(G) C*(@) 
U o Ù 

@ L(@) 


Remark. Since the natural embeddings of C*(@) into A(G) and c4** 
are both isometries, it follows that the restriction of the correspondence 
Fok of Theorem 3.1, to C*(G), is an isometry. More precisely, if C*(G) 
is considered to be a subset of e4** and if F—> F denotes the natural mapping . 
of cA** onto A(G), then | F || =|| FJ, for all F in C*(@). 


THEOREM 3.3. The unit ball G,(G), is weakly compact. 


Proof. If J, is a net in @,(G), converging weakly to J in Q (G), then, 
for each L in G°, Jı(L) is a net converging weakly to J(L). Since Jı(L) 
is contained in the unit ball, ¥,(9), of the algebra of operators on X 
and since ¥,(%) is weakly closed, it follows that J(L) is contained in 
L(A), for all L in Ge. Thus J is contained in G,(@). Hence (,(G) is 
weakly closed. 

Let c4,** denote the ball of e4** of radius 2. cA4,?* is weak* compact 
in ef**, (Cf. Corollary 4, page 41 of [1].) By Theorem 3.1, oA,** is 
weakly compact, and contains the weakly closed set @.(@). Thus @,(@) 
is weakly compact. 


4. A remark on the choice of axioms for @(G). The reader should 
note that the choice of the two axioms used to define the elments of @ (G) 
was strongly motivated by the work of Tadao Tannaka. In his paper, [14], 
Tannaka considered certain mappings of the set of finite dimensional repre- 
sentations of a compact group into matrices, satisfying a certain list of axioms. 
On the basis of his list it would appear natural to require certain properties 
in addition to those specified in Definition 1.1. The following theorem states 
that these are already implied by the two axioms already specified. 


THEOREM 4.1. Each option J in A(G) satisfies the following two 
properties. 


(1) If L is an element of G* and U is a unitary operator on St, then 
J(UALU) = UI (L)U. 
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(2) I£ L is an element of @°, then J(L) is contained in the von 
Neumann algebra QA (L), generated by the range of L. 


Proof. (1) For each y in 91, we have that the elemente Tr,vs,0y and 
fosLo.y.y of cA* are identical. Let 9 denote the element of e4** for which 
GJ. Then $(fr,vy,0v) = 9 (forryy) and thus 


. (J (L) Oy, Up) = (J (UL) yp, 4) 
for all y in Y. Hence U--U(L)U =J(U“LU). 


(2) Choose an element L in G°. Then the map L’: J>J(L) maps 
A(G) into £(9). By the definition of the weak topology of @(G@), L/ is 
continuous relative to the weak topology of @(G@) and the weak operator 
` topology of (9%). Since C*(@) is weakly dense in A(G), we conclude 
that L’(C*(@)) is weakly dense in L’/(@(G)). Hence @(L), which is the 
weak closure of L’(C*(G@)), contains L/(@(@)). 


5. Other topologies for Z(G). 

Remark on Terminology. A number of topologies have been considered 
on the collection £(3%) of bounded linear operators on a Hilbert space 9. 
In addition to the uniform, the strong and the weak operator topologies, 
John von Neumann [12] considered the locally convex topology determined 
by the family of semi-norms on E(X) of the form 


T- [X] Ty E 


where {4} denotes a sequence in such that £ | y|? < +o. Von Neu- 
{1 


mann called this the “strongest” topology on £ (%). This terminology does 
violence to the English language, in that this topology is strictly weaker 
than the uniform topology, whenever % is infinite dimensional. Perhaps 
because of this fact, Jacques Dixmier chose to refer to this topology by the 
term “ultra-forte” in the French language (cf. [2]). In the paper [2], 
Jacques Dixmier considers another locally convex topology on £(%), deter- 
mined by the family of semi-norms on £(%) of the form 


TS (TH #0)| 


where- {yı} and {¢;} are sequences in 3/, such that Siw <+w and 
2 lel? < Fpa: In a latter paper, [3] » Professor Dixmier, by reason of 
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symmetry, introduces the term “ultra-faible” to refer to this topology. How 
should the terms “ultra-forte” and ultra-faible” be translated into English? 
If one requires the translation to be invertible, “ultra-forte” should revert 
back to “ strongest” and, by symmetry, “ultra-faible” would become 
“weakest.” However this terminology is completely unsatisfactory, for not 
only is the “ultra-faible” topology not the weakest topology, it is in general 
strictly stronger than the weak topology. For this same reason, the use of 
the English term “ultra-weak” for the French term “ultra-faible” is 
unsatisfactory. 

The author wishes, in this section, to introduce analogues of each of 
these topologies, for @(G). Since we do not wish the perpetuate this con- 
fusing terminology in a new context, we shall offer a new term to replace 
the term “strongest operator topology,” as well as an English term to be 
used in translating the French term “ultra-faible.” 


Convention. Henceforth the strongest topology in (9) (in French 
“ultra-forte”) will be referred to as the o-strong topology. ‘The French term 
“ultra-faible” will be translated “o-weak.” 


Definition 5.1. Consider the collection of all semi-norms on @ (G) of 
the form J> || J(Z)y |, where y is a vector in ¥, and L is an element of @°. 
‘This collection of semi-norms defines on @(G) a locally convex Hausdorff 
topology which we call the strong topology of A(G). A neighborhood base 
of the origin is given by the collection of neighborhoods of the form 


NO; L5- + +, Lda + 5 yn) = (J: JE ACG) and [I (L*) yi] S1 
for i=1,: + -,n} 
where LEG and wE H, i=], +n 


This topology is characterized as the smallest topology of Q (G) such 
that, for each L in G°, the map J>J(L), of A(G) into (MH) is continuous 
relative to the strong operator topology. 


Definition 5.2. Let {yx} denote a sequence of elements of Y wich 
that > ll ys]? << +00 and let Lt denote a sequence of elements of @°. Then 
i 
for each J in G (G), we have 
È 17y PSE al He. 
iA 1 
Thus the function 
J—> [SNL PP 
4-1 
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is a semi-norm on @(@). The set of all such semi-norms on A(G) defines 
a Hausdorff locally convex topology which we call the o-strong topology of 
(G). A neighborhood base of the origin is given by the collection of 
neighborhoods of the form 


A (05; {L}, (i}) ={7: TE aca) and (SII I el}. 


where {Lt} is a sequence in G° and {y} is a sequence in # a ‘that 
= lyf? < +o. . 

‚Definition 5.3. Let {ys} and {¢4} denote two sequences of elements of 
9% such that Xy? <te and Dlg? <ta. Let {I} denote a 
sequence in 6°: Then for each J in a), the funetion 


IE] 


is a semi-norm on @(G@). The set of all such semi-norms defines a Hausdorff 
locally convex topology on @ (G), which we call the o-weak topology of A(G). 
The collection of semi-norms of the form 


J=>| > (J (Li) po ys) | 


where {y} is in ¥, and >» | jl < +o, suficen to define this topology. A 


neighborhood base of fer origin is given by finite intersections of neighbor- 
hoods of the form 


N (03 (49, (W) =F: ICAO) and |È (I(L Yo y)|S1) 


where {L*} is a sequence in G° and {y} is a sequence in 9 such that 


È Iyl < +e. 

Let the symbol D designate the term “contains.” Then we have the 
following diagram of the topologies of a(@). 
uniform topology D o-strong topology D strong topology 
U U 

o-weak topology D weak topology. 
The techniques developed in the study of the corresponding topologies 
for (H) (cf. Section 8, Chapter 1 of [4]) may be applied in this context 
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to obtain the following unsurprising results. The linear operations, as well 
as the maps of A(G) into A(G) of the form J>JK and J-> KJ where K 
is an element of @(G), are continuous in any one of the five topologies. The 
involution J —>J* is continuous in the weak and the o-weak topologies. The 
map (J,K)>JK of Gi(G) x @(G@) into A(G) is continuous in the strong 
and o-strong topologies. 


THEOREM 5.4. The weak and the o-weak topologies of O(G) coincide 
on bounded sets. 


Proof. Let A,(@) = {J: Je A(G) and | J || Sr} where r is a positive 
number. We will show that the weak and o-weak topologies coincide on 


Suppose M is a set of the form 
Mm={J: J€ A(G) and 1% (J(L) ww) |< 


where {Z*} is a sequence in G° and {yı} is a sequence in % such that 


Syl? < +o. Choose an integer n such that I ||? 1/2r. Let 
4 n+l : 


M = {J: JE A(G) and (IL (V ny), (Vn) )| E Li=1, n} 
Then if Je M N Q,(G), we have 


IÈ wW SÈ mw +S yw) 


Sn(1/en) +19 È Im’ 
< 1/2 +r(1/2r) = 1. 
Hence MN A(O C MNA A(G). 
Every fundamental o-weak neighborhood N of the origin is of the form 


N om N M, where M; is a set of the form Mm described above and m is a 


positive integer. By the above argument, corresponding to each My, there is 
a weak neighborhood Mm; of the origin such that 


min a,(4) C M,N aG). 
Thus N’ = ñ M; is a weak neighborhood of the origin and 


wnae =f m/) Nna A M) NA, (4) —=NN A(G). 


482 JOHN ERNEST. 


THEOREM 5.5. The strong and the o-strong topologies of A(G) coin- 
cide on bounded sets. 


The proof of this theorem is completely analogous to that of the previous 
theorem. 


THEOREM 5.6. The restrictions of each of the topologies weak, o-weak, 
strong, o-strong, to the set U of unitary elements of A(G), are identical. 


Proof. On the basis of the previous two theorems, it is sufficient to 
show that the weak and the strong topologies coincide on U. 


Suppose {Jı} is a net in U which converges weakly to J in U. Since 
the involution is weakly continuous in @(G) we have that Jı* converges 
to J*. By the weak continuity of multiplication by a fixed element we have 
that {Jı*J} converges weakly to J*J==I and also that {J*J,} converges 
weakly to J*J =I. Hence for each y in # and each L in G°, 


KAT (Ey (F(Z) IH) LAD) IWW) 
S|(—J*(L)(L) vo W)| 
+|(@—A*(L)I(L) 59) | 


Hence the fact that J*J, and J,*J both converge weakly to J, implies that J) 
converges that J converges strongly to J. 


COROLLARY 5.7. U is a Hausdorff topological group relative to the 
weak (equivalently the o-weak, strong, or o-strong) topologies. 


Proof. The inverse operation is continuous since the involution is weakly 
continuous. Multiplication is continuous since multiplication on bounded ~ 
sets is strongly continuous. 


COROLLARY 5.8. The restriction of any of the four topologies, weak, 
o-weak, strong, o-strong, to G, ts identical with the gwen topology of G. 


‘Proof. This follows immediately from Theorem 5.6 and Theorem 2.3. 


6. The representation of G (G) asa Von Neumann algebra. Grothen- 
dieck [9] and Takeda [13] have developed a way of representing the Banach 
space e4** as linear operators on a: Hilbert space.. On the basis of this 
representation, e4** is given a *-algebra structure such that cA** is a von 
Neumann algebra. In our case, however, @ (GŒ) is given as a C*-algebra. 
The technique of Grothendieck and Takeda is easily adapted to show that 
Q@(@) may be represented isomorphically and isometrically as a weakly closed 
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*-algebra of operators, on an (in general non-separable) Buben apace H. 
The isomorphism is a o-strong homeomorphism. 


Definition of the Representation of A(G). Let H == > © Hx, denote 


the Hilbert space direct sum of œ copies of #, where a pee the cardinal 
of G° and Yr = H, for every L in G°. Thus a vector y in H is a vector 
valued function on G°, L> yr, such that yr is contained in & for each 
L in G°, where only a countable number of the yr, are non-zero and 
p l wr l? <œ. For convenience in examining the components of y, we 


shall usually denote y by {Wx}. 

We define the map ¢ of @(G) into operators acting on H, by the 
requirement $(J) {wz} = {J(L)yr} for all J in @(G) and {yz} in H. It is 
easy to verify that, for each J, (J) is a bounded linear operator on H, 
and in fact | ¢(J)|<]J |. 


THROREM 6.1. $(Q(G@)) is a von Neumann algebra. > is a *-algebra 
isomorphism and isometry of A(G) onto (A(G)). The extent to which 
the topologies correspond is given in the following list. 


1) ¢ is a homeomorphism relative to the o-strong topology of A(G) 
and the o-strong operator topology of ¢(A(@)). 


2) œ i.a homeomorphism relative to the o-weak topology of ace ) 
and the o-weak operator topology of ¢(A(G)). 


3) ¢ is an open mapping, relative to the strong topology of a(6) 
and the strong operator topology of ¢(A(G@)). 


4) isan open mapping, relative to the weak topology of a(@) and 
the weak operator topology of ¢(A(G)). 


Proof. We leave to the reader the verification that ¢ is a 4 shadbirn 
isomorphism. ¢ is then an isometry, since every *-algebra isomorphism of a 
C*-algebra into a C*-algebra preserves norm. (Cf. page 311 of [11].) 

We next show that & is continuous relative to the o-strong topology of 
A(G) and the o-strong operator topology of €(H). Let N denote a funda- 
mental o-strong neighborhood of the origin in £(H). Then there exists a 
sequence {y;} in H such that j 


Š [y< -+o and Mm (T: Pe L(A) and È| Ty c1) 


For each L in @°, let P(L) denote the projection of H onto its L-th coordi- 
nate. Thus for each integer j, there are at most a countable number ‘of 


2 
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points {LY} in G° such that P(L4)y,;40. Rearrange the double sequence 
of pairs {(L4, P(L#)y,)} into a single sequence {(Z*,¢z)}. Note that 


Elo PS SIPC Sly < +e. 
Ki gal 4221 
Let N denote the o-strong neighborhood of the origin of @(@) defined by 
N=(J:J€a(@) and Š J(I*) $s £1). 


The reader may then verify that (N) CN. 


A completely similar technique may be used to show that ¢ is continuous 
relative to the o-weak topology of A(G) and the o-weak operator topology 
of £(H). 

We next show that ¢(@(@)) is a von Neumann Cron ‘Theorem 3.3 
and Theorem 5.4 imply that the unit ball @,(G@) is o-weak compact. Since 
¢@ is an isometry and is o-weak continuous, the unit ball of ¢(@(@)) is 
o-weak compact and hence o-weak closed. By Corollary 2, page 44 of [4], 
#(A(@)) is a von Neumann algebra. 

We next show that ¢ is an open mapping of A(G) onto ¢(A(G@)) 
relative to the o-weak topology of @(@) and the o-weak operator topology 
of #(A(@)). Let N denote a fundamental o-strong neighborhood of the 
origin of A(G). Then N is of the form 


N = (J: Te A(G) and STL) ulP SY) 


where {y} is a sequence of vectors in Y for which Si pyl? <+ and 
+1 


{L*} is a sequence of elements of G°. Let y; denote the element of H whose 
L*-th-component is yi, and for which every other component is zero. Let N 
denote the o-strong neighborhood of the origin of ¢(@(G@)) defined by 


N={T: Te $(Q(@)) and A Th |? S1). 


The reader may then verify that N C (h). 


By a completely similar technique, one may verify that ¢ is an open 
mapping of A(G) onto ¢(@(@)), relative to the strong (respectively weak, 
a-weak) topology of Q (G) and the strong verein weak, o-weak) operator 
topology of ¢(@(@)). 
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` COROLLARY 6.2. Let ¢, denote the restriction of ¢ to the unit ball 
A(G) of A(G). Then ¢, is a homeomorphism relative to the strong (respec- 
tively weak) topology of Aı(@) and the strong (respectively weak) operator 
topology of #(Q1(@)). 


COROLLARY 6.3. The classical group algebras, L'(G), O* (G) and M(@) 
are each dense in A(G), relative to any one of the topologies, weak, o-weak, 
strong, o-strong, of A(G). 


Proof. It is sufficient to show that these classical group algebras are 
dense in the strongest of these topologies, namely the o-strong topology. By 
Corollary 3.2, each of these group algebras is weakly dense in A(G). Since 
¢ is an open map relative to the weak topology of Q (G) and the weak operator 
topology of o(2(@)), o(L*(G@)), o(C*(@)) and ¢(M(G@)) are each weakly 
dense in ¢(@(G)). Since $(A(G)) is a von Neumann algebra, von Neu- 
mann’s density theorem (Theorem 2, page 43 of [4]) implies that ¢(L*(@)), 
#(C*(@)) and ¢(M(G@)) are each o-strong dense in ¢(@(G@)). Since ¢ is 
a o-strong homeomorphism, we conclude that Z!(@), C*(@) and M(@) are 
each o-strong dense in A(G). 


COROLLARY 6.4. Every separable locally compact group G is homeo- 
morphic and isomorphic to a group of unitary operators acting on a Hilbert 
space, where the unitary group is considered as a topological group relative 
to any one of the four topologies, weak, o-weak, strong, or o-strong. 


Proof. This observation ig an immediate consequence of Corollary 5.8 
and Corollary 6.2. 


7. The group G generates the group algebra Q (G). When G is a finite 
group, the group algebra is obtained simply by taking linear combinations 
of group elements. Thus an algebra is associated with the group by the 
same procedure that one associates an algebra with the range of each repre- 
sentation of the group. The classical group algebras for locally compact 
groups have no analogous property. This L!(@) and C*(@) in general do 
‘not even contain the group, and the elements of the algebra are obtained by 
integration over the group. The measure group algebra M(G) contains 
the group, but there is no natural sense in which @ generates M(@) as a 
topological algebra. In this section we shall show that G generates Q (G@) 
in the sense that the smallest weakly closed *-subalgebra of Q (G), containing 
G, is A(G) itself. Thus @ generates @ (G) in the same manner in which 
one associates an algebra with the range of each representation of G. It is in 
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this sense that the author argues that @(G@) is the natural analogue of the 
‚group algebra of a finite group. 

We first note that in the isomorphic representation ¢ of aia) as a 
von Neumann algebra, the elements of L!(@) are related to the elements 
of G by the expected formula. 


Lemma 7.1. Consider G and L(G) as embedded in A(G), according 
to Section 2. Let p denote the representation of O (G) described in Section 6. 
Then for all y in H and f in L*(@), 


OOY — f 1C) dv) aula). 


We leave the proof of this lemma to the reader. 


THRORRM 7.2. Let cA(@) denote the *-algebra of elements of A(G), 
which are complex linear combinations of elements of G. Let cA,(@) denote 
the unit ball of A(G). Then 


(i) cA(G@) is dense in Q (G), relative to any one of the four topologies, 
weak, o-weak, strong and o-strong. 


(ii) eAı(@) is dense in G,(G@), relative to any one of the four 
topologies, weak, o-weak, strong and o-strong. 


Proof. Suppose T is a linear operator on H, which commutes with all 
the elements of ¢(G@). Lemma 7.1 may then be used to verify that T com- 
mutes with each element of $(L!(G)). The double commutator theorem 
implies that the von Neumann algebra generated by (@(@),- contains 
$(L*(@)). Since ¢(Z*(@)) is weakly dense in ¢(@(@)), we conclude that 
¢(@(G@)) is the von Neumann algebra generated by #(G). Thus ¢(e4(@)) 
is o-strong dense in ¢ (Q (G)) and 6(c4,(G@)) is o-strong dense in $(€:(@)). 
Since ¢ is a o-strong homeomorphism, we have that e4(@) is o-strong dense 
‘in A(G) and cA,(@) is o-strong dense in dı(@). The theorem now follows 
since the o-strong topology is the strongest of the four topologies mentioned. 


COROLLARY 7.3. Q(G) is commutative if and only if G is commutative. 


Notice that the corresponding fact for each of the classical group algebras 
follows immediately from this corollary, since each of the classical group 
algebras is dense in Z(G). 


Tuxorrm 7.4. The group G forms a linearly independent set in the 
linear topological space Q (G). 
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Proof. Let 2,:-+,2, denote any finite set of distinct elements of G 


and suppose {a} is a set of complex scalars such that Mew;—0. Then, 
H 4=1 


(Sag) (L) — Zub, =0 
q=1 ei 


for all L in @°. Taking L to be a representation equivalent to the regular 
representation we conclude that 


n 


È af (zry) = 0 
ii 
for all f in L? (G) and u- almost all y in G, where » denotes Haar measure 
on @. 
Let U denote a compact neighborhood of the identity element of G, for 
which UN 2,0 = p, whenever 154j, where ¢ denotes the empty set. Let 
x denote the characteristic function of U. Then x is an element of L?(@) 


and hence Š ayy (ory) —0 for p- almost all y in G. Integrating this 
izt 


expression, with respect to u, over the set z,;U gives yu(U)==0 and hence ` 
aj==0. 


8. Representation theory. The main deficiency of the measure group 
algebra M(@) is that the restriction of a *-representation of M(@), to G, 
need not be strongly continnous. Thus there appears to be no reasonable 
analogue of the well known correspondence between the *-representation 
theory of L!(G) and C*(@), and the strongly continuous unitary represen- 
tation theory of G. The purpose of this section is to produce a reasonable 
analogue of this situation, in the case of the algebra A(G). 


Definition 8.1. We say that an element J in Ü(@) is positive if 
(J (L), y) 20 for all L in G° and y in %. The set of positive elements 
of A(G) will be denoted @(G)*. We say JK, where J and K are elements 
of d(G)+, if (K—J)¢€ da (@)*. 

The reader should have no difficulty in verifying that this partial 
ordering is exactly the partial ordering induced by the partial ordering among 
the positive elements of the von Neumann algebra ¢(@(G@)), where ¢ is the 
isomorphism described in Section 6. 


Definition 8.2. We define a normal representation of A(G) to be a 
*-algebra homomorphism T into a von Neumann algebra such that, if C is 
a chain in @(G@)*, with supremum J in @(@)*, then T(J) is the supremum 
of T(C). 
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THEOREM 8.3. Let L be an element of G°. Define the map I’ of 
A(G) into A(L), the von Neumann algebra generated by the range of L, 
by L(I) =J (L), for all J in A(G). Then I’ is a normal representation 
of A(G) onto A(L). The restriction of L’ to G is L. 


If T is a normal, representation of A(G), with representation space X, 
then the restriction of T to G is a strongly continuous unitary representation 
L of G, and L’ =T. 


For each I in G°, L ts irreducible (respectively primary, type I, type II, 
type III, finite, infinite, multiplicity free) if and only if I’ is irreducible 
(respectively primary, type I, type II, type III, finite, infinite, multiplicity 
free). 


For each pair of representations L and M in @°, L ts equivalent (respec- 
tively quasi-equivalent) to M tf and only if L’ is equivalent (respectively quasi- 
equivalent) to M’. ` 


Proof. L’ is easily verified to be a *-algebra homomorphism of Q (G) 
into @ (L). By the definition of the weak topology of @(G@), the positive 
linear forms J > (J (L), y), where yE &, are weakly continuous and hence 
o-weakly continuous on Q (G). Hence by Theorem 1, page 54 of [4], all 
such positive linear forms are normal. Hence the representation L’ is a 
normal representation. By Corollary 2, page 57 of [4], I'(A(G)) is a von 
Neumann algebra. Since L’(G(@)) contains the range of L, we have 
L/(Q(G@))=(L). For each z in G, L/(x)==4(L)—=L,. Thus the 
restriction of L’ to G is just L. l 

Suppose T is a normal representation of Q (G), with representation space 
3. Since Q (G) is homeomorphic to a von Neumann algebra, relative to the 
o-strong topology, T is o-strong continuous. Since the strong and the o-strong 
topologies are identical on G, it follows that the restriction L of T to G is a 
strongly continuous unitary representation acting on the space X. Thus L 
is-an element of G°. Note that T and L’ are both o-strong continuous +- 
representations of @(G), which have identical restrictions to G. Theorem 7.2 
implies that T == L’. 

The third paragraph of the theorem is an immediate consequence of the 
fact that, for each L in @*, the range of I’ is @ (L). 

Suppose L and M are in G° and L=M. Then there exists a unitary 
operator U on % such that L == UMU. Theorem 4.1 implies that, for each 
Jind(@), 
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If (J) =J (L) =J(UMU+) =UJ(M)U"—- UM (J) U+. 


Thus [’—UM’U~ and hence L’ == M’. The corresponding result for quasi: 
equivalence follows from Lemma 4 of [5]. 


Remark. Since L!(G) and C*(G) are contained in A(G), the *-repre- 
sentation theory of L!(G) and C*(@) can be obtained by restricting normal - 
representations of @ (G) to these subalgebras. It is not difficult to show that 
all no-where trivial, separable *-representations of L (G) and C*(@) are 
obtained in this way. Thus the simple process of restriction gives rise to a 
four-way correspondence between the normal representation theory of A(G), 
the no-where trivial *-representation theory of L!(G) and C*(G), and the 
unitary representation theory of G. These correspondences commute. Thus 
the classical theory of the correspondence between the representations of G 
and of L(G), is canonically embedded in this new theory. 

The question arises as to whether normal representations are in fact the 
natural representations to consider when studying the big group algebra 
A(G). The following theorem is an attempt to answer this question in the 
affirmative. 


THEOREM. 8.4. Let T denote a bounded separable *-representation of 
A(G). Then the following five conditions are equivalent. 


(i) T is a normal representation. 


(ii) T is continuous relative to the weak operator topology and the 
weak topology of A(G). 


(iii) T is continuous relative to the o-weak operator topology and the 
o-weak topology of A(G). 


(iv) T is continuous relative to the strong operator topology and the 
strong topology of A(G). 


(vr) T is continuous relative to the o-strong operator topology and the 
o-strong topology of A(G). . 


Proof. By Theorem 8.3, each normal representation 7 is of the form 
T == L’, where L is the restriction of T to G. However every map of the 
form J —>J (L) =L’ (J) satisfies the continuity conditions (ii) through (v), 
by the definition of the different topologies for Q (G). 


Conversely, suppose T satisfies any one of the continuity conditions (ii) 
through (v). “Then the restriction of T to G gives a strongly continuous 
unitary representation L of G. Since the representation I” satisfies conditions 
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(ii) through (v), Theorem 7.2 implies T=L’. Thus Theorem 8.3 implies 
that T is normal.. 

According to Corollary 5.7, the group U of unitary coment of A(G), 
is a Hausdorff topological group, relative to any one of the topologies weak, 
o-weak, strong and o-strong. The restriction of any normal representation 
of @(G@) gives rise to a strongly continuous unitary representation of U. 
‘Thus ‘Theorem 8.3 implies that the unitary representation theory of G and 
the unitary representation theory of u, are identical, 


THEOREM 8.3. Every noait; strongly caii unitary represen- 
tation L of G may be extended, uniquely, to a strongly continuous unitary 
representation L’ of U. The von Neumann algebra A(L) generated by the 
range of L is equal to the von Neumann algebra generated by the range of L’. 
This correspondence between representations of G and of U, preserves the 
usual representation theoretic properties. (Cf. the last two paragraphs of 
Theorem 8.3.) 


9. Characterization of the unitary group U or A(G). 


Definition 9.1. An option J in Q (GY is said to preserve tensor products 
if, whenever U is a linear isometry of # OH onto % and whenever L mig 
M are elements of G°, then 


J(U(LO M)U+) =U (J (L) @J(M))U, 


An option J in @(@) is said to preserve tensor powers if, whenever U 
is a linear isometry of YQ 9 onto Y and L is an element of G°, then 


J(U(L@L)U+) =U (J (L) 9J (L)) U+. 


In the Tannaka duality theorem [14], referred to in Section 4, the 
mappings are required to preserve tensor products. In addition, each repre- 
sentation must map into an invertible matrix and each unitary representation 
must map into a unitary matrix. In this paper, however, we are only 
considering unitary representations. Under this restriction, the requirement 
‘that tensor products be preserved is equivalent to the requirement that repre- 
‘sentations map into unitary operators. Indeed we obtain the following 
-characterization of the unitary group U of A(G). 


THEOREM 9.2. Suppose J is an invertible element of A(G). Then the 
‚following three conditions are equivalent. 
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(i) J ts unitary. 
(ii) J preserves tensor powers. 


(iii) J preserves tensor products. 


Proof. We first prove that (ii) implies (i). Let J denote an element 
of A(G) which ‘preserves tensor powers. _ 

Suppose |J | > 1. Then there exists an L in G° Such that | J(L) | 
=a 1. Let 8 denote any positive number. Then there exists an integer m 
(of the form 2") such that a > Bp. Let M—=U(II@L)U™, where TOL 


denotes the tensor product of m copies of L and U is a linear isometry of 
the representation space of [[@L onto %. Then M is an element of @° 
m 


and |J (M) —] J (L) |” =a” 8. Thus the function M — || J(M)|| is not 
bounded on @°, in contradiction to the first requirement in the definition of . 
an option (cf. Definition 1.1). Thus | J | <1. 

It is easy to verify that if J is invertible and preserves tensor products, 
then J? preserves tensor products. By the previous paragraph, we have 
that |J7?]S1. Thus [JJ] SJ 7] 1. Hence || Ji —1 
and |J || =1. 

Suppose, for some ernten L in @°, that J(L) is not an isometry. 
Then there exists a vector y in Y such that || y | =—1 and ]J(L)jy | =08 <1. 
Since J (L) is invertible, we know «0. Then ||(1/a)J(L)y|==1 and 
|J*CL) ((1/a)J(Z)y) || = (1/«) > 1, which implies | J] > 1, which is a 
contradiction. Thus for each L in G°, J (L) is an invertible linear isometry 
on 9 and thus a unitary operator on %. Hence J is unitary. 

We next prove that (i) implies (iii). Suppose M and N are two repre- 
sentations in G°, and that U is a linear isometry of 9% onto the representation 
space of MON. Let L-=-U(M@N)U-. Then L is an element of G°. 
Let L’ denote the unitary representation of U given by Theorem 8.5, i.e., 
let L’(J) =J(L) for all J in U. Define the map © of U into unitary 
operators on Y by &(J) = U(J(M) @J(N))U+ for all J in U. Then & 
is.easily verified to be a strongly continuous unitary representation of U, 
whose restriction to @ is just L. By the uniqueness portion of Theorem 8.5, 
we have 6— JL’. Thus for each J in U, J(U(M @ON)U*) —J(L) = LJ) 
om (J) =U (J (M) @I(N))U+. 
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BRANCHED REGULAR CURVE FAMILIES AND FINITE 
ASYMPTOTIC VALUES. 


By Davip V. V. Wenn. 


Introduction. The level curves of the real part of a function analytic 
in.a simply connected domain form a branched regular curve family, i.e, a 
family of curves which is locally homeomorphic to parallel lines at every 
point of the domain except at most at an isolated set of branch points at 
each of which the family has a singularity of the multiple saddle point type. 
Conversely, Boothby [2,3] has shown that any given branched regular curve 
family filling a simply connected domain is homeomorphic to the family of 
level curves of a harmonic function. Such a harmonic function will be 
said to be contoured by the curve family. The main purpose of this paper 
is to investigate some relations between the structure of a branched regular 
curve family and the finite asymptotic values of analytic functions the real 
or imaginary parts of which are contoured by the given family. In particular 
we obtain sufficient conditions that any analytic function with real or imagi- 
nary part contoured by a given family have a certain minimum number of 
distinct finite asymptotic values and sufficient conditions that there exists an 
analytic function with no finite asymptotic value with real or imaginary part 
contoured by a given family. As a result we obtain precise characterizations 
of the level curve families of harmonic polynomials. 

In Section 1 we consider some basic definitions and properties relating 
to finite asymptotic values and branched regular curve families including the 
definition of the important b-curves. In Section 2 we give some sufficient 
conditions on a branched regular curve family F that any analytic function 
with real part contoured by F shall have at least a certain minimum number 
of finite asymptotic values. In particular we prove that a b-curve of F con- 
tains the homeomorphic image of a finite asymptotic path for any analytic 
function with real part contoured by F. In Section 3 the restrictions are 
put on F that F contain no b-curve and that at most a finite number of 
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curves of F which have a branch point as limit point. intersect any given 
bounded subset of the plane. Then we show the existence of an analytic 
function with no finite asymptotic value whose real part is contoured. by F.. 
Finally we consider the level curve families of harmonic polynomials: they 
are homeomorphic precisely to those branched regular curve families filling 
the plane which contain no b-curves and have at most a finite number of 
branch points. u 


1. Preliminary definitions and theorems. 


1.1. Finite asymptotic values. Suppose f(z) is a function defined in a 
simply connected domain D of the complex plane and c: g= h(t), OSt <1, 
is a path in D such that h(t) tends to the boundary of D as ¢ tends to 1. 
If imf(k(t)) as t—1 exists and is finite, then the limit is said to be a 
finite asymptotic value of f(z) and c is a finite asymptotic path of f(z) [4]. 

Following Iversen [1, p. 271], [6] and [11], the finite asymptotic values 
of an analytic function approached along two paths will be considered the 
same if and only if they correspond to the same boundary point of the 
Riemann surface of the inverse function, and in the case when the values 
are the same the paths will be called equivalent finite asymptotic paths. 


1.2. Branched regular curve families. Next we consider some defini- 
tions and properties relating to branched regular curve families. For a 
detailed study of such families including definitions and proofs of properties 
listed below the reader is referred to the papers by W. Boothby [2,3]. 


1.2.1. Curve families. A curve is the homeomorphic image of an open 
interval, a half open interval or a closed interval. A family F of curves will 
be said to fill a subset R of the complex plane if and only if every curve of 
F is in R and every point of R lies on one and only one curve of F. If U is 
a subset of R such that each curve c of F intersects U in a set cN U each of 
whose components is a curve, then we denote by F[U] the curve family filling 
U whose curves are the components of cN U for all c in F. If the curve 
family F fills R and the curve family G fills 8, then F and G will be called 
homeomorphic if there is a homeomorphism of R onto 9 such that the image 
of each curve of F is a curve of G. 


1.2.2. Regular points and branch points. Let F be a curve family 
filling a set R. The family F will be said to be regular at a point P of Rand 
P will be said to be a regular point of F if there is a neighborhood U(P) of P 
to which P is interior relative to R-and such that F[U(P)] is homeomorphic 
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to the family of segments y =c, —l<z<1, -1<c<1. F will be 
called a regular curve family filling R if it is regular at each point of R. 
Let C, denote the unit disk |z| <1. A point B on the boundary of R will 
be called a branch point if there is a positive integer % and a ‘neighborhood 
U(B) of B such that F[U(b)—B] is homeomorphic to the level curve 
family of Re(2"), n> 1, in Cy minus the origin under a homeomorphism h 
which maps U(B) onto C, with h(B) = 0. The integer n is the multiplicity 
of B, and B will be called a branch point of order n. . 

Let + denote the finite complex plane. Suppose F is regular throughout 
a region R=r—ß, where 8 consists solely of branch points. Then F will 
be called a branched regular curve family. Henceforth F will denote a 
branched regular curve family filling + minus the set of branch points. For 
convenience we have dropped the phrase “minus the set of branch points” 
and referred simply to curve families filling a simply connected domain, and 
we shall in general continue to do so. 

Since the results we obtain depend only on the topological structure of 
the curve families under consideration, there will be no loss in generality in 
assuming that the curve families fill + minus the set of branch points. _ 


1.2.3. The curves, chains and trees of F. A curve of F is the homeo- 
morphic image of an open interval. There are two types of curves: regular 
curves which tend to infinity in each direction and branched curves which 
have a branch point as limit in at least one direction and have at most one 
limiting point or endpoint, necessarily a branch point, in any given direction. 

Since F can contain no closed curve or simple polygon of branched curves 
[2, p. 412], there are exactly 2n branched curves with a given branch point 
of order n as endpoint. If B is a branch point, the set of branched curves 
of F with B as an endpoint, together with their endpoints, forms a set called 
the star of B, denoted by St(B). We shall call two branched curves c and ¢ 
of 8t(B) clockwise adjacent if in the order induced on Sé(B) by the orien- 
tation of m moving clockwise around B, ¢’ is the unique curve which follows 
immediately after c. If œ, c form a clockwise adjacent pair, then c, d will 
be counterclockwise adjacent. 

If the union of the curves of a collection k of branched curves together 
with their endpoints forms a simple curve c, we call k a chain. If the curve 
c tends to infinity in both directions, then we shall call k an infinite chain. 
If one of the regions into which c separates contains no branched curve 
with a limit point on c, then & is called a mazimal chain. 

Suppose c is a fixed branched curve of F. Then the collection of all 
curves c’ of F such that there is a finite chain containing c and ¢ forms, 
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preti with the endpoints of the curves of the collection, a ur tree. 
‘For future reference we state the following theorems.- 


THEOREM 1, 2-1. [2, p. 421] If T is a tree, then each curve of T 
is contained in exactly two maximal chains which intersect only on this 
curve, and every branch point of order n is contained in exactly 2n maximal 
chains whose only common point is the branch point itself. 


THEOREM 1.2-2. [2, p. 421] A maximal chain of a tree T divides x 
into two domains whose complete boundary it is, and one of these domains 
contains no point of T. 


Let c be. a branched curve. By Theorem 1.2-1 there are exactly two 
maximal chains m and m’ containing c. If we delete the open curve c from 
mU m’, then (m Um’) —c.consists of at most two disjoint chains, each of 
which we shall call a mized mazimal chain. An element of F will mean a 
‚regular curve, maximal chain or mixed maximal chain of F. 


_Note. When we use the terms chain, infinite chain, maximal chain, 
- element, etc., in the point set sense, we include the endpoints of the branched 
curves involved. 


THEOREM 1.2-3. [2, p. 480] If K is any compact subset of m, then 
there are at most a finite number of distinct trees of F whict intersect K on 
more than one curve of the tree, and no more than a finite number of curves 
from any one tree can intersect K. 

We say the trees of F are isolated if any compact set in ~ intersects at 
most a finite number of trees of F. 


1.2.4. Chordal relations and cyclic sets. See W. Kaplan [8,9] for a 
detailed discussion of chordal systems for regular curve families. Suppose 
c is a regular curve or infinite chain (including endpoints). Then c separates 
a into two complementary domains. Denote one of these domains by D(c). 
Then the other domain will be. denoted by D*(c). Suppose b, c and d are 
three nonintersecting elements of F. If c separates b and d, then we write 
b/c/d. If none of b, c and d separates the other two, then b, c and d form 
the boundary of a simply connected domain, and we write |b,c,d|. A non- 
empty set V of disjoint elements will be said to be cyclic if |b,c,d| for 
every three elements b, c and dof V. If V is a cyclic set, then the elements 
of V form the complete boundary of a simply connected domain which will 
be denoted by 6(V). If V contains only one element c, then 6(V) = D(c) 
for arbitrary choice of D(c). l 
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1.2.5. The b-curves of F. If b is a regular curve. or maximal chain 
of F, b will be called a boundary curve or b-curve if there exists a regular 
curve or maximal chain c of F such that no curve in 6(b,c) has an endpoint 
on b or c and no regular curve or infinite chain separates 6 and c. It follows 
that c must also be a b-curve: We call such a pair b, c a pair of related b- 
curves. Our definition generalizes to branched regular curve families the 
definition of b-curve given by Cullen [5, p. 15]. 


1.2.6. Cross-sections. A curve is a cross-section of F if and only if 
it is contained in + minus the set of branch points of F and intersects each 
chain or regular curve of F in at most one point. In particular no cross- 
section can intersect a maximal chain or tree twice. A cross-section v is said 
to tend properly to infinity in a given direction on v if x tends to infinity 
in that direction in such a manner that the curves and trees of F meeting 2 
tend: to infinity with their intersection points on z. I.e. for each compact 
set K in ~ there exists a compact set K’ containing K such that if the point 
of intersection of a curve c of F with & lies outside K’, then c and any tree 
containing ¢ lie entirely outside K. If a cross-section tends to infinity in a 
given direction but does not tend properly to infinity in that direction, then 
we say it tends improperly to infinity in that direction. 


THEOREM 1.2-4. [3, p. 530] If Pisa regular point on a regular 
curve or infinite chain c of F and D(c) has been chosen, then there is a cross- 
section of F which starts at P and tends properly to infinity in D(c). 


. We say a curve, chain or tree c of F is accessible from a point P if 
there is a cross-section of F containing P and a point of c. A curve, chain 
or tree c will be accessible from another curve, chain or tree ¢’ of F if c is 
accessible from some point of cd’. 


‚1.2.7. Parallel familhes. Let x be a cross-section of F. Then we ' 
denote by F(z) the set of curves of F which intersect s. The union S of 
the curves of F(z) fills an open simply connected set, and there is a homeo- 
morphism of S onto (1) a strip OS yl, (2) a half-plane y= 0 or (8) the 
zy-plane, carrying the curves of S onto the lines y = constant and x into the 
y-axis, the case depending on whether (1) z is an arc, (2) æ is a half-open 
curve or (3) z is an open curve, respectively [3, p. 514]. The family S will 
be called a parallel family in each case. 


THEOREM 1.2-5. [8, p. 531] The boundary of a parallel family 8 is 
a collection of maximal chains, mixed maximal chains and regular curves, 
and a mixed maximal chain c lies on the boundary of 8 tf and only if D(c) 
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can be chosen to contain 8,.at the same time one and only one curve d of 
the tree to which c belongs enters D(c) from a branch point of c and the 
curve d is an element of 8. 


The following theorem follows from the fact that a pärallel family is 
homeomorphic to a set of lines filling a simply connected region. 


THEOREM 1.2-6. The boundary of a parallel family forms a cyclic set 
of elements of F. 


The definition of parallel family also leads to the following theorem. 


THEOREM 1. 2-7. Suppose b, c and d are curves of a parallel’ family 
S==F (x), where z is the curve z= h(t), OStS1, OSt <1 or 0<t<1, 
and b=F(h(t,)), the curve of F through s—h(t.), c—F(h(t,)) and 
d=F{(h(t,)), where to <t, <t,. Then b/c/d in 8. 


1.2.8. Complementary families and functions contoured by them. Sup- 
pose F and @ are branched regular curve families filling =. We say G is 
complementary to F if (1) the branch points of G are exactly those of F 
and each is of the same order, i.e. a point B is an n-th order branch point 
of @ if and only if it is an n-th order branch point of F, and: (2) every 
curve of .@ is a cross-section of F. If G is complementary to F, then F is 
complementary to G. : 


THEOREM 1. 2-8. [8, p.\626] Every brancha regular curve family has 
at Kt one com piem oiimy family. 


. Adapting terminology used by Moie and Jenkins [7], we use the term 
conjugate net for a pair of complementary curve families, and we say a 
conjugate net (F, G) contours a function f(z), or f(z) is contoured by (F, G), 
if F and @ are homeomorphic to the families of level curves of the real 
and imaginary parts of f(z) respectively under the same homeomorphism. 
We shall also say that F contours a real-valued function u(z, y) if F is 
homeomorphic to the family of level curves of u. 

A real-valued function u(z,y) =u(P) is called an allowable function 
contoured by F if . 


. (1) u(P) is defined and continuous for all P in r; 
(2) for every real number & the locus u(P) —k, if not empty, con- 


sists of a finite or an at most countably infinite collection of trees and regular 
curves of F; 


(8) u(P) is. -strictly monotone on any cross-section of F; age 
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(4) in every neighborhood of any point P in ~ there exist points Q 
for which u(Q) <u(P) and points R for which u(R) >u(P). 


It is not hard to show as a consequence of Theorem 1.2-4 that property 
(3) implies property (4). The function u is pseudo-harmonic as defined in 
Morse [10, p. 5], and is contoured directly by F. ne 

If u is an allowable function contoured by F, v is an allowable function 
contoured by G and (F,@) is a conjugate net, then we say the composite 
function u-+ iv is an allowable function contoured by (F,@). 

Suppose f(z) is defined in a.domain D of ~ and g(z) is defined in a 
domain E of x. We call f(z) and g(z) topologically equivalent [14] if there 
exists a u a h of D onto’ FE such that g(h(z)) f(z) for all 
gin D.. 


THEOREM 1.2-9. Suppose fa ) is an allowable function contoured by a 
conjugate net (F,G). Then f is topologically equivalent to a function 
analytic either in m or Co. Conversely, if g is an analytic function con- 
toured by a conjugate net (F,@) under a homeomorphism h, then g is 
topologically equivalent under h to an allowable function contoured an (F, gi 
See [3, pp. 526-527]. . 


Remark. As a consequence of Theorem 1.2-9 we have the following 
results. Suppose F contours the real part of an analytic function f == u -+ iv 
under a homeomorphism h.. Then the level curve family of v is homeomorphic 
under A! to a family G complementary to F, the conjugate net (F,@) 
contours f and f is topologically equivalent under A! to an allowable function 
contoured by. (F, Œ). l 

Suppose f(z) is an allowable function contoured by a conjugate net 
(F,@). If f is topologically equivalent under a homeomorphism A to an 
analytic function g, then a path c is a finite asymptotic path of f if and 
only if h(c) is a finite asymptotic path of g. Thus, for a given family F, 
‘in order to show that any analytic function with real part contoured by F 
must have a finite asymptotic value, it suffices to show that for any family 
@ complementary to F any corresponding allowable function f==u + iv 
contoured by (F,@) has a finite asymptotic value. For by the remark above, 
if F contours the real part of an analytic function g, then g is topologically 
equivalent to an allowable function contoured by a conjugate net (F,@). 
Conversely, in order to show that there is an analytic function f the real part 
of which is contoured by F which has no finite asymptotic value, it is sufficient 
to construct a family G complementary to F and show the existence of an 
allowable function contoured by (F,@) which has no finite asymptotic value. 
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2. Finite asymptotic paths and the b-curves of f. 
2.1. Finite asymptotic paths and b-curves. 


Lemma 2.1-1. Let b and c be related b-curves of a Bonka regular 
curve family F, and suppose x is a cross-section of F starting at a regular 
point of c and terminating at a point of a regular curve contained in #(b, c). 
Then b lies entirely on the boundary of 8 =F (x). 


Proof. By Theorem 1.2-5, the boundary of $ consists of regular curves, 
maximal chains and mixed maximal chains. Since b is a b-curve related to C, 
either b is a regular curve or a maximal chain, and in the latter case no 
branched curve of the tree containing b can lie in #(d,c). Hence b either 
lies entirely on the boundary of S or does not intersect the boundary. at all: 
In the latter case, let b’ be the boundary of the component of the complement 
of 8 which contains b. Since 8 is contained in cU 4(d,c), b’s4c. But then 
b/b’/c, contrary to the assumption b and c are related b-curves, hence 
separated by no regular curve or infinite chain of F. 


Lemma 2.1-2. If (#,@) is a conjugate net and a curve of G tends 
improperly to infinity relative to F in a gwen direction, then that curve con- 
tains a finite asymptotic path p in the given direction for any allowable 
function f =u + iv contoured by (F,@). 


Proof. The function u is monotone on p, hence either tends to +% or 
is bounded and tends to a finite limit along p. But p tends improperly to 
infinity, hence the values of u are bounded on p and tend to a finite limit up. 
If v = v, on p, then f(z) tends to the finite asymptotic value uo + iv, along p. 


THEOREM 2.1-1. Let b and c be related b-curves of a branched regular 
curve family F. Then any allowable function f=u-+tiv with real part 
contoured by F has a fintte asymptotic path. 


Proof. Let @ be the family complementary to F which contours v, and 
let P be a regular point of c and z= G (P), the curve of @ which contains 
P. Let z intersect a regular curve s of #(b,c), and let 2” represent the 
open are of z between P and sN s’. Let S’—=F(2’) Uc. By Lemma 2. 1-1, 
b lies on the boundary of 9. Let Q be a regular point of b and y= @(Q), 
and let y intersect a regular curve s of 8’ in a point A. Since 8’ is a parallel 
family, c/s/s’. Let y’ be the are of y between Q and A, a be the arc of s 
between 4 and B =z N s, x be the arc of x” between P and B and S= F(x). 
Then 'UaUy is a cut of (b,c), separating #(b,c) into two disjoint 
regions C and D. Let D be the region which contains the unbounded portions 
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of s. Since no curve or tree of F can intersect the cross-sections x’ and y’ 
more than once and each curve of S intersects 2’ and y’, it follows that all 
regular curves of J tend to infinity in both directions in D and no branched 
curve of S can have an endpoint in C. Let b’ be the arc of b which lies on 
the boundary of C. See Figure 2.1. 





FIGURE 2.1. 


Suppose g € G enters C from a point of b’. The cross-section g of F will 
intersect a regular curve $” of S, since the regular curves are dense in r. 
Since g cannot intersect s” again, g either must terminate at a branch point 
in the subregion R of C bounded by 7’, y’, s and s”, intersect « or y’ or 
intersect s. Note that E is bounded since both s and s’ tend to © in both 
directions in D, hence intersect both 2’ and y’. But there are no branch 
points in C and 2’ and y’ are arcs of regular curves of G, hence g does not 
intersect them. Therefore g intersects s between A and B, i.e. g intersects a. 
Hence an @(b’) is a subarc a’ of a with one endpoint A. Let M be the 
other endpoint of a’ and let m = G(M). 

Now we show that m tends to infinity in SMC. Suppose m intersects 
a boundary element d of S N C at a point M’. Then the arc m’ of m between 
a and d is a cut of S N C: say SAC —C’U m UC” and suppose b’ lies on 
the boundary of C’. The point M’ separates d into two parts, one of which, 
say d’, lies on the boundary of C’. Let N be a point of d’ such that 
n==G(N) is a regular curve. Then by the same argument as above, n 
intersects a’. But then n separates the connected set G(b’), which is impos- 
sible. Therefore m intersects no boundary element of C other than s, hence 
m tends to infinity in SNC. 

Now suppose that vu, on c, v=, on m and let m be the curve 
z= h(t), 0<t<1l, where we may suppose z tends to infinity along m in 
SOC as t approaches 0. If m intersects curves c’, c” of 8 at points h(t’), 
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h(t’) respectively, then by Theorem 1. 2-7, c/c’/c” if andionly if 0 < Y <t. 
Hence as ¢ tends to 0, the corresponding curves of 8, F(k(t)), intersect the 
cross-section 2’ between P and B defined above in points which approach P. 
Therefore f(z) approaches the finite asymptotic value to + ivo along z = h(t) 
as t tends to 0, hence m contains a finite asymptotic path of f(z). 


Note. By considering the values of f(z) along b’ and a’, a similar 
argument shows that b’ is a finite asymptotic path of f(z) and f(z) approaches 
the value to + iv, along b’. Also from the above proof we note that b’ tends 
to infinity improperly relative to any complementary family @ and the curve 
m of G tends improperly to infinity relative to F. By Lemma 2.1-2, this 
implies immediately the existence of a finite asymptotic value of F. 

Since by definition b-curves always occur in related pairs, as a conse- 
quence of the Remark following Theorem 1.2-9 we have the ne 
corollary. 


COROLLARY 2.1-1-1. If a branched regular curve family F contains a 
b-curve, then any analytic function with real part contoured by F has a ne 
asymptotic value. 


COROLLARY 2. 1-1-2. The level curve family of a harmonic polynomial 
contains no b-curve. 


Proof. Suppose.u(z,y) is a harmonic polynomial. Let v(z,y) be a 
harmonic conjugate. Then. f(z) == u-}iv is a polynomial, and since the 
values of a polynomial tend to infinity along any path which tends to RENI 
Corollary 2. 1-1-2 olowg, at once from Corolany 2. 1. 1-1. 


 THEoREM 2.1-2. Let c be a regular curve or mazimal chain of a 
branched regular curve family F, and let D(c) be chosen. Suppose bi, be, 
bs, - + form a (possibly infinite) collection of curves each member of which 
ts contained in D(c) and is a b-curve related to c. Then for any allow- 
able fancier: f(z) —u-iv with real part contoured by F and each b, 
i= 1,2,3,: - -, there oond a finite asymptotic path gı such that if 
tj, j=], 2, 3,° °°, then the corresponding finite asymptotic values of 
f(z) approached ee a and g; respectively are distinct. 


« , Proof, Let V designate the-collection of curves 6, by, bs, 63, © +. Since 
b, is contained in D(c) and is related to c for eäch t—"1,9,3,----, Visa 
cyclic set. Let the curve family G and the point P of c be given as’ in the 
proof of Theorem 2. 1-1, and let.2—G(P) intersect a regular curve s of 6(V). 
Let ‘2’ be ‘the ‘are of ¢ between P and s, and let S> F(a’). Let X, be a 
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disk with center P and radius nn n1,2,3,---. It follows from Theorem 
1.2-3 by an argument similar to that in [8, p. 175], that at most a finite 
number of elements of V intersect K, for each n. Suppose n is fixed. Then 
as in the proof of Theorem 2.1-1, for each element b; of V which intersects 
x, & regular curve s, of 8 can be found which is accessible by an arc of a 
‚regular curve of G from a point of b; By an extension of Theorem 1.2-7, 
one of these curves s, call it s(n), will separate the other s; from c and will 
be accessible by elements of G from each of the curves b; which intersect Ky. 
“Note that in general s(n) may not be accessible from elements of V which do 
not intersect K,; in particular the existence of a branched curve of S may 
interfere. i i gr 

Now consider the elements of V which intersect Kam. There exists a 
regular curve s(n-+1) of S such that c/s(n+1)/s(n) and s(n-+1) is 
‚accessible from each element which intersects K,,1. Note that a cross-section 
from b; to s(n) will also contain a cross-section from b; to s(n + 1). 

As in the proof of Theorem 2.1-1, corresponding to each element b, of 
- V which intersects K, there will be an arc a(n) of s(n) consisting of the 
intersections with s(n) of the curves of @ which intersect a half-infinite sub- 
are of b, a(n) having endpoints A(n) and M,(n), such that G(H,(n)) 
‘contains a finite asymptotic path of any allowable function f(z) =u-+ iv 
contoured by (#,G). Since v is monotone on s(n) for given n, the finite 
asymptotic values approached along the curves G(M;,(n)) corresponding to the 
-elements of V which intersect K, are all distinct complex numbers. If 
-G(Mi(n)) has been chosen for s(n) accessible from b; then G(M4(n)) also inter- 
sects s(n+r), r==1,2,---, in the points M(n+r). Hence G(M,(n-+1)) 
is independent of r. Let gı =- G@(Mi(n)). Since any element of V will inter- 
‘sect K, for n sufficiently large, a finite asymptotic path g: is associated with 
each element b; of V. Also, if b; and b; are any two elements of V, then 
there will be an integer n such that both b; and b; intersect K,, and as noted 
above the finite asymptotic values approached along the corresponding finite 
asymptotic paths gı and g; are distinct. ~ 


_ Note. As in Theorem 2. 1-1 it can be shown that each of the b; contains 
a finite asymptotic path along which f(z) approaches the same value as along 
the corresponding path g.. 


2.2. Cyclic sets and b-curves. Since c and the related b-curves b, in 
Theorem 2.1-2 form a cyclic set, this would indicate that there might be 
some relation between the existence of a cyclic set and the existence of finite 
asymptotic paths. That a cyclic set does not necessarily imply the existence 
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of a finite asymptotic path is shown by the example of the level curve family 
of u = Re(z*), where for fixed c, > 0 and c < 0 the curves u = c, and u = c; 
form a cyclic set V while f(z) =z? has no finite asymptotic value. In this 
example 6(V) contains the branch point z—-0. It turns out this is crucial; 
in fact we have the following theorem. 


THEOREM 2.2-1. If F is a branched regular curve family and V is a 
cyclic set consisting of three or more elements of F such that 6(V) contains 
‘no branched curve of F, then 0(V) U V contains at least two related b-curves. 


Proof. Let V contain the elements b, c and d, P be a regular point of b 
and x be a cross-section of F which tends to infinity in the side D(b) which 
contains c and d. Theorem 1.2-4 guarantees the existence of such a cross- 
section. Let 2 =— F(z) N(Y), S==F(2’) and let c’ (d’) be the boundary 
of the component of the complement of S which contains c (d). Suppose 
x U P is represented by z = h(t), OS t< t 1, where P == h(0). Suppose 
x intersects d, so h(t,) is a point of d. We distinguish four possible cases. 


Case 1. -For all s.in 8, b/s/c’. Then | c’,s,d| for all s in S, and ¢ 
and d are related b-curves since d = d’. 


Case 2. There exists 4, 0< t< t, such that if 0< tS to then 
b/F(h(t))/c while if to < t< tu then |b, F(h(t)),e|. Then F(h(t,)) and 
ce’ are related b-curves. 


Case 3. There exists to, 0 < to < tı such that b/F(h(t))/c’ whenever 
0<t<t, while |b, F(h(i)),e| iftSt<t. Then F(h(to)) is aa a 
b-eurve related to c’. 


Case 4. For alls in 8, |b,s,c’|. Then b and c’ are related b-curves. 


Suppose 0<t<t’<t,. Then it is impossible for both |b, F(h(t)),¢’ | 
and b/F(h(t’))/c’ to hold. Hence the above cases are the only ones possible 
when x intersects d, and c’ is always a b-curve related to b, d or an element 
of 8. 

The proof is similar when z intersects another boundary element of V or 
tends to infinity in 6(V). 

A somewhat complicated induction proof [13] shows that whenever V 
contains n= 3 elements and 6(V) contains no branched curve, then there 
exists a set of at least n— 1 related b-curves in 6(V) UV. However, some 
or all of the corresponding finite asymptotic paths may be equivalent, as is 
shown by the example of the set of level curves Re(e*) == c for fixed c0 
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which is an infinite cyclic set of a regular curve family with no branched 
curves contouring the real part of an analytic function with only one finite 
asymptotic value. 

Theorem 2. 2-1 has no exact converse, as the example illustrated in Figure 
2.2 shows. In Figure 2.2 the branch points recede to infinity to the right. 
The family is a parallel family in each component of the complement of 
6(b,c). The curves b and c are related b-curves. Note that the trees are not 
isolated. However we do have the following result. 


SSC 


m 


FIGURE 2.2. 


THEOREM 2.2-2. If F is a branched regular curve family which contains 
a b-curve and the trees of F are tsolated, then there exists a cyclic set V 
containing three or more elements such that 6(V) contains no branched curve. 


Proof. Let b be a b-curve of F and suppose c is a related b-curve. Let 
x be a cross-section of F starting at a regular point P of b and terminating 
at a point Q of a regular curve r of 6(b,c). Then by Lemma 2.1-1, b and c 
lie entirely on the boundary of S = F(z). Let x be the curve z= h(t), 
0S:S1, where h(0) =P and h(1) =Q. Since the trees of F are isolated, 
at most a finite number of branched curves can intersect z. Hence there 
exists a t’, 0 < t 1, such that for 0<¢tS?’, F(h(t)) is a regular curve. 
Let x’ be the subarc z = h (t), OS t St, and 9 =F (x). Then b, c,F(h(t’)) 
and the other elements on the boundary of 8’ form the desired cyclic set by 
Theorem 1. 2-6. 


COROLLARY 2. 2-2-1. If the trees of F are isolated, then F contains a 
b-curve if and only if F contains a cyclic set V containing three or more 
elements such that 0(V) contains no branched curve. 


We conclude this section by observing that as a consequence of Lemma 
2.1-2 we can formulate another sufficient condition that F contain a finite 
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asymptotic path for any allowable function with real part contoured by F, 
namely: Each family G complementary to F contains a curve which tends ' 
improperly to infinity relative to F. The existence of such a curve is anaes - 
by the existence of a b-curve in F. 


3. Sufficient condition that F contour an allowable function with 
no finite asymptotic value. In this section we prove the principal sufficiency 
‘theorem: If F contains no b-curves and the trees of F are isolated, then F- 
contours the real part of an allowable function with no finite asymptotic value. 
An interesting consequence of this result is that the level. curve families of 
harmonic polynomials are characterized by the properties that each family 
‚contains only a finite number of branch points and no b-curves. ` > 

Throughout this section we assume that F is a branched regular curve 
family filling the plane r, F contains no b-curve and the trees of F are isolated, 
i.e. at most a finite number. of- trees intersect any given bounded subset of r. 
We first partially order the trees of F by separation and orient the regions 
-detérmined by the trees. Then we define an allowable function u contoured 
‘by F and show the existence of a family G complementary to F and an allow- 
able function v contoured by G such that the allowable function u + Ww con- 
toured by (F,@) has no finite asymptotic value. 


3.1. The regions of m—2. Let 3 denote the set of trees of F and let 
H=r—2. 


THEOREM 3.1-1. The set H is the union of open disjoint regions each 
of which has at most two elements of F on tts boundary. 


Proof. Let P be an element of H and N a bounded neighborhood of P. 
The point P, being a regular point, is not a limit point of any branched . 
curve, and since the trees of F are isolated, Theorem 1.2-3 implies that at 
-most a finite number of branched curves can intersect N. Hence there is a 
-neighborhood of P contained in N which lies entirely in H and so H is an 
„open set. Let Q be a component of H. Since each boundary element of Q 
‚separates m, the boundary of Q forms a cyclic set V. Since Q contains no 
branched curves, if V contains three or more elements, then by Theorem 2. 2-1 
-F eontains.a b-curve. Hence V contains at most two elements. 


THEOREM 3.1-2. Let Q be a component of H. Then F[Q] is a parallel 
family, and if Q has two boundary elements, then each curve of F[Q] separates 
‚them. Also, if c is a boundary element of Q, D(c) contains Q and x is a 
cross-section of F which tends properly to infinity in D(c), then F[Q] 
=F (1N Q). 
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: “Proof. Let c be a boundary element of Q and choose D(c) to contain Q. 
Let z be a cross-section of F starting at a regular point P of c and tending 
.properly to infinity in D (c), and let S = F (zN Q). Suppose Q has only the 
one boundary element c. Then Q==D(c) and contains F(x). Suppose g 
is a curve of F[Q] not in F(a). If all curves of § separate q and c, then x 
does not tend properly to infinity. If some curve s of S does not separate q 
and ¢, then q, sand c form a cyclic set V such that 6(V) contains no branched 
curve. But then F contains a b-curve. In either case a contradiction is 
reached, so F(z) == F[Q]. 

Suppose Q has a second boundary element d. If some curve of F(zNQ) 
does not separate c and d, then as above F contains a b-curve. Hence « 
intersects d and again either F contains a b-curve or F(z Q) =F[Q]. 


3.2. Adjacent sequences of trees and regions. Throughout the remainder 
of Section 3 a region will mean a region of H unless otherwise specified. Two 
regions will be said to be adjacent regions if they have a common branched 
curve on their boundaries. An adjacent sequence of regions is a sequence of 
‚regions Ry, Ra - +, En such that Æ; and Ria are adjacent, +==1,2,- - tel, 
If an adjacent sequence of regions contains the regions R and S, we say È is 
connected to S by the sequence. An adjacent sequence of regions connecting 
two regions R and 8 will be said to be a minimal sequence of n regions if it 
contains exactly n regions and no adjacent sequence of fewer than n regions 
connects R and 8. 

A region will be said to- be adjacent to a tree T if there is a as 
chain of T belonging to its boundary ; the tree will also be said to be adjacent 
to the region. Two trees will be said to be adjacent trees if they are adjacent 
to a common region. Let T, be a fixed tree of F. If T and T’ are trees and 
T separates T, and 7”, then we write T< T. We define To <T for all 
TÆT, . The relation <- gives a partial ordering of the trees of F relative 
to To. , An adjacent sequence of trees connecting T, and T is a set of trees 
Tao Tas oo, Ta such that T,= To TaT, T, and Tin are adjacent trees 
and ner, im 1,2, 7,n—1. 


THEOREM 3.2-1. Let T, be a fixed tree of F. If! T is any tree + of F, 
then there is a unique adjacent sequence of trees connecting Te and T. 


Proof. Suppose T” <T and T” <T, T’4T,AT”’. The complement 
of T” is the union of disjoint regions of x. Let U be the region containing 
T, and V the region containing T. Since 7’<T, U and Y are distinct. 
If T” lies in U, then, since T” < T; T” < T”. If T” lies in V, then T” < T”. 
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If T” lies neither in U nor F, then there is a path in U from T, to a point 
P of T’, there is a path in V from T to a point Q of T” and from the 
definition of a tree there is a path along a finite chain of T” from P to Q. 
Hence T” < T is false, contrary to hypothesis. Therefore the trees separating 
T, and T can be simply ordered by <. Since the trees of F are. isolated, 
there can be but a finite number of them separating T, and T and simply 
. ordering them by <, we get a unique adjacent sequence connecting Te and T. 


Definition 3.2-1. Let n(T) represent the number of trees in the 
adjacent sequence of trees connecting T, and T. I.e. n(T)—2 represents 
the number of trees separating T, and T, n= 2. 


THEOREM 3.2-2. If R and S are any two regions of H, then there is 
a minimal sequence of regions of H connecting R and 8. 


Proof. Let A be the union of all the regions of H which can be con- 
nected to a fixed region R by an adjacent sequence. Let A’ be the interior 
of A, where A is the closure of A, and B=r— 4’. Let PEB. If P is not 
on a tree, then P is contained in a region of H contained in B. If P isa 
regular point of a tree, then: by Theorem 1.2-1, P is on the boundary of 
exactly two regions, V and W, of H. If V is in A, then V is connected to 
E by an adjacent sequence p, hence W is connected to R:by the sequence p, 
V, so W is also in A. But then PEA’. Similarly if W is contained in A, 
PEA’. Therefore Pe Int(V UW) CB. If P isa branch point, then by 
Theorem 1.2-1 there are exactly 2n regions determined by the 2n maximal 
chains which contain P. If any one of these regions is contained in A, then 
all of them are contained in A, since in going around P in a clockwise direction 
any two of these regions are clearly connected by an adjacent sequence of 2n 
or fewer of these regions. Therefore P again is contained in an open set 
contained in B. Hence B is an open set. But then » is the union of two 
disjoint open sets, so, since A contains R, hence is nonempty, B is empty. 
Therefore each region of H can be connected to a fixed region of H by an 
adjacent sequence. Among the adjacent sequences connecting two regiois 
there will be one or more minimal sequences. 


THEOREM 3.2-3. If Rand 8 are distinct regions of H each connected 
to a gwen region R, by a minimal sequence of n regions, n= 2, then R and 8 
are not adjacent. 


Proof. Since each component of the boundary of a region of H is a 
maximal chain and each branch point lies on the boundary of at least four 
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regions of H, no three regions can be adjacent to each other. Therefore if 
me= 2, then R and S are adjacent to Ry, hence not adjacent to each other. 

Suppose the theorem is true for sequences containing n— 1 regions or 
less and suppose Æ and S are regions of H connected to Re by respective mini- 
mal sequences p: Ro = Ra, Ry: + +,Ry—F and o: By = Say Ie - +, Sp 8, 
n> 2. If for some 1= 2, R: and S; coincide, then by the induction hypothesis 
applied to the sequences Re By, ‚Rand Ri= Si Suu’ tt, Rand S 
are not adjacent. 

Suppose R; and S; are distinct for all1=2. Let R, be adjacent to Ry 
‘along a curve b and S, be adjacent to R, along a curve c. If b and c belong 
to distinct boundary chains of Ro, then: R, separates R and 8. Suppose b 
and c belong to a boundary chain k of R, and are separated on k by a curve d. 
Then the region W adjacent to R, along d belongs neither to -p nor a, since 
p and o are minimal sequences. Therefore R,U W separates R and S. 
Suppose b and c have a common endpoint B. If W is one of the regions 
of H with B on its boundary and W is not an element of p or o, then Ry U W 
separates R and $. Suppose all regions of H with B on their boundary are 
in p or o. Then there will be a branched curve of St(B) on the boundary 
of both a region of p and a region of o. ‘Since there are an even number of 
regions with B on their boundary of which R, is one, R; and 9; are distinct 
for i > 2 and p and o are minimal sequences, the subscripts of these adjacent 
regions will differ by exactly one, say the adjacent regions are R, and Su, 
#22. Then the sequences R, Ry.,-°-,R and Ry Sua’ e e, S satisfy the 
induction hypotheses, so R and $ are not adjacent in this case either. 

' In order to define the functions u and v and the complementary family G 
it will be convenient to define a positive direction on each chain of F and 
an orientation for each region. Throughout the remainder of this section 
R, will denote a fixed region adjacent to the fixed tree To. 

We now associate with each region a sequence of numbers. 





Definition 3.2-2. Let E be a region. Then m(R) will denote the 
minimum of the numbers n(T) for all trees T adjacent to R. 

Let R, have the sequence (1). Suppose S is a region adjacent to Ro. 
Then 8 will have a sequence (1,e), where e=1 if m(S) >i, e==—1 if 
m(S.) == 1.- Suppose sequences have been chosen for all regions connected 
to Ry by minimal sequences of n —-1 or fewer regions, one sequence of numbers 
for each minimal sequence of regions. Let § be a region connected to Ry by 
a minimal sequence of regions o with n terms, and suppose R is the region 
‘of o adjacent to 9. Let p be the sequence of numbers corresponding to the 
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subsequence of n—1 regions of o connecting R, and R. If the last term 
in p is 1, let the sequence corresponding to S be (p,1) if m(R) < m(8) 
and („—1) if m(R)==m(8). Ifthe last term of p is — 1, let the sequence 
corresponding to S be (p, —1) ifm(R) < m) and (p,1) if m(R) =m(8). 
See Figure 3.1. 





Frevure 3.1. 


- Since by Theorem 3.1-1 no region can be adjacent to three trees, it 
follows that if R is a region adjacent to two trees T and T”, then either T < T” 
or T< T, and if n(T) <n(T’), then T <T. As a consequence, if R and 

S are adjacent regions and m(R) < m(8), then either R == R, or R separates 
R, and 8. Conversely, it is clear that if R separates R, and S, then, since Ro 
is adjacent to To, m(R) <m(8). Hence if S; and Si are two consecutive 
regions in a minimal sequence o connecting R, and 9, t> 1, and p is the 
corresponding sequence of numbers, then the terms in p corresponding to & 
and Suı will have like signs if and only if S; separates R, and Si. If S; 
separates R, and Si,1, then S; separates R, and S. Hence S, must occur in 
the same place in any other minimal sequence of regions o’ connecting Ro 
and $. Furthermore if 8%; is the region of o’ following S, then m(S,) 
< m(S’w), so that in the sequence of numbers p’ corresponding to o’, the 
terms corresponding to 8; and S’ also have like signs. Since all sequences 
start with 1, it follows that p and p’ coincide and there is a unique sequence 

“associated with each region. 


Definition 3.2-3. Let y(R) be the sign of the last term in the sequence 
for R. 


Definition 3.2-4. Let n(R) denote the number of terms in a minimal 
sequence connecting R, and R. 


3.3. Orientation of the maximal chains of F. Let R be a region. If 
y(#) is +, give R a positive (counterclockwise) orientation, while if y(R) 
is —, give R a negative (clockwise) orientation. Suppose k is a maximal 
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chain of a tree T. It will lie entirely on the boundary. of one and only one. 
region E. If m(R)=n(T), then define the positive direction on k so it 
coincides with the orientation of R. In more detail, let B be a branch point 
of k and b and c be the elements of St(B) which lie on k. Suppose R is 
positively oriented. Then choose the positive direction on k so that going 
along k in the positive direction, if b is reached first before c, then c, b are 
counterclockwise adjacent, while if c is reached first, then b, c are counter- 
clockwise adjacent. If R has a negative orientation, then define the positive 
direction on k so that going along k in the positive direction, if b is reached 
first, then c, b are clockwise adjacent, while if c is reached first, then b, c 
are clockwise adjacent. If m(R) <n(T), then define the positive direction 
on k to be the opposite to the orientation of R. 


THEOREM 3.3-1. The maximal chains of F are consistently oriented. 


Proof. Let k be a maximal chain and b a curve of k. By Theorem 1. 2-1, 
b is contained in exactly two maximal chains k and k’ lying on the boundaries 
of regions R and § respectively. Since R and S are adjacent, by Theorem 
3.2-3, n(R) and n(S) differ by exactly one. Suppose n(R) <n(9), and 
suppose R and S have the same orientation. Then m(R) <m(8), so 
m(R) <n(T), T the tree on which & and # lie, and k receives a positive 
direction opposite to the orientation of R while k’ receives a positive direction 
coinciding with the orientation of 8. Hence b receives the same positive 
direction considered as a curve of k or k’. If R and S have opposite orien- 
tations, then m(R)—=m(8), and m(R)=n(T)—=m($8). Therefore k 
receives a positive direction coinciding with the orientation of R while k 
receives a positive direction coinciding with the orientation of 8. Since R 
and S have opposite orientations, b receives the same positive direction con- 


sidered as a curve of k or k’. Hence the maximal chains of F have been 
N: oriented. 


3.4. ' The definition of u(P). We now define an allowable function u 
contoured by F such that | u | tends to © on any cross-section of F which 
tends properly to infinity. 

Let T&T, be a tree of F. Suppose T’ is the tree adjacent to T in 
the adjacent sequence of trees connecting T, and T and R is the region 
adjacent to both T and 7”. If y(R) >0, let u=n(T) on T, while if 
y(E) <0, let u——n(T) on T. Letu=1 on To. 

. Suppose R is a region with a maximal chain k of a tree T on its boundary. 
Choose D(k) to contain R and let z: z— f(t), OSt<1, be a cross-section 
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tending properly to infinity in D (k) from a point P of k. eas u = Up 
on: ‘k. If k is the only boundary chain of R, then define 


u= | uo | (1+ tan (m/2)t)y(R) 


on the curve F(f(t)), 0<t<1. Note that since n(T) Z1, u0. ER 
has a second boundary chain, then s intersects it at some point f(to), 
0 < to < 1, as shown in the proof of Theorem 3.1-2. Suppose u = u at f (to). 
Then we define u == Up + (t/t) (u — to) on F(f(t)), 0<t< to Defining 
u in similar fashion on all the regions, Theorem 3.1-2 and the discussion in 
Section 1.2.7 guarantee that u is defined and continuous on all of F and is 
contoured by F. . 


Note 1. If R has only one boundary chain, then u tends to y(R)® as 
t tends to 1. 


Note 2. If R has two boundary chains which are subsets of trees T 
and T” respectively such that n(T) <n(T”), then if R has a positive orien- 
tation, u, = | uo | + 1 > us and u increases on s as t tends to t, while if R 
has a negative orientation, Bere, < u, and u decreases on & as 
t tends to to. 

We now verify that u is an allowable function contoured by F. See 
Section 1.2.8. Property (1) follows from the definition. Since the trees 
and regions are countably infinite at most and u assumes a given value on 
at most one curve in each region, Property (2) is also satisfied. Suppose æ 
is a cross-section of F and z is contained in a region R. Since u is continuous ` 
on x, z intersects each curve of F at most once and u assumes a given value 
on at most one curve of F[R], u must be monotone on s. Suppose & inter- 
sects two adjacent regions, R and 8. Then u is monotone on + # and 
zN S. Suppose R and 8 both have positive orientation and n(R) < n(8). 
Then m(R) < m(8) and either R == R, or R separates R, and $. In either 
case there is a tree T adjacent to R and 9 and a tree 7” adjacent to R such 
that n(7’”) <n(T), and by note 2 above u increases on z as z approaches T. 
Since y(R) > 0, uu) >0 on T, and since y(8) > 0, u increases on x as 
© recedes from T as a consequence of notes 1 and 2 above. Hence u is mono- 
tone on y = (rN È) U (zN 8). A similar argument shows u is monotone 
on a if y(R) and y($) are both negative. 

Suppose Æ and § have opposite orientations. Then m(R) =—m(S), and 
again it follows from the definition of u and notes 1 and 2 that u is monotone 
on 2’. Thus u is monotone on each section 2’ of z which intersects two 
adjacent regions, and therefore u is monotone on all of x. 
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Suppose z is a cross-section of F which tends properly to infinity. If x 
intersects an infinite number of trees, then these trees can be simply ordered 
by <, and |u| tends to © on z. If x intersects only a finite number of 
trees, then z tends to infinity in a region R. It follows from Theorem 3. 1-2 
that R has but one boundary chain k and, after extending v to k if necessary, 
F[R] —F(xAR). From the definition of u in R, |u| tends to œ on zN R. 


8.5. The definition and properties of G and v. In this section we prove 
the following theorem. 


THEOREM 3.5-1. There exists a family G complementary to F such 
that each regular curve or infinite chain of G tends properly to infinity in 
each direction relative to F, and there exists an allowable function v con- 
toured by G such that |v| tends to œ on each element of F and to no finite 
limit on any infinite chain of F. 


3.5.1. The definition of v and G. First we define v on the trees of F. 
Let T be a tree of F and B, a fixed branch point of T. Let v=~0 at Bo. 
Suppose B is a branch point in St(B,) —B o. Then the branched curve BoB 
belongs to exactly two maximal chains k and k’ of T which have been given 
a consistent orientation in Section 3.3. If the direction from B, to B is 
positive along k, let v1 at B; if B is in the negative direction along k 
from Bo, let v ==— 1 at B. In general if v has been assigned the value n at a 
branch point B of T, then let v—-n-+1 at a branch point B’ of St(B) —B 
if the direction from B to B’ is positive, v-n—1 at B’ if the direction 
from B to B’ is negative. Since there is a unique finite chain connecting any 
two branch points of T, v will be defined and single valued at each branch 
point of T. 

Suppose b is a branched curve z = f(t), O<¢<1, and b has two end 
points, Zn) and BY = limf (t) on T. If vn at B and n+1 


(n—1) at B. then define ans (=n—t) at f(t), an IE b 
has only one end point B, where v =n, let 


ven tan(a/2)t (vn—tan(r/2)t) 


if the direction from B to © along b is positive (negative). Define v in 
similar fashion on each tree of F. Then v is continuous and monotone on 
each maximal chain k of F, and |v | tends to œ in each direction on k. 

Let R be a region and let k be a maximal chain lying on the boundary 
of R. Choose D(k) to contain R and let = be a cross-section which tends 
properly -to infinity in D(k) from a regular point on k. Then as a conse- 
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quence of Theorem 3.1-2 and the results in Section 1.2.7, kU R can be 
mapped by .a homeomorphism / onto the. family of lines y = c, 0-& c < 1; in 
the zy-plane, k going onto the line y==0. Let R’—& minus the set of 
branch points of F. -If R has no other boundary element, then define 
the curves of Gin R’ to be the intersection with R’ of the inverse images - 
under hi of the line segments o,: 2—c, OS y <1, —w<c<o, and define 
v on h*(o,) to have the value of v at A*(c,0) on k. If R is adjacent to 
another maximal chain m, then z must intersect m, and kU RU M can be 
mapped by a homeomorphism » onto the family of lines y == c, OScS1, 
k going onto the line y= 0, m going onto the line-y—1. Connect by 
straight line segments the images under h of the points P and P’, on k and 
m respectively, where v(P) = v(P’). Since by the definition of the orien- 
tations of the maximal chains of F given in Section 3.3 both k and m have 
the same positive direction, these line segments will not intersect each other. 
Define G in A’ to be the inverse images under h of these line segments. 
Since |v| tends to o in both directions and is monotone on both & and m, 
all the points of k and m will be connected in a one-to-one fashion by curves 
of G[R’]. Define v on G[R’] as above. Let two arcs or half-open curves 
of G be part of the same curve of @ if they. have a common endpoint which 
is a regular point of F. 


3.5.2. Verification that G is complementary to F. om the definition, 
each curve of @ is a cross-section of F and G is regular at each point. of, H. 
Let P be a point of a tree T. By Theorem 1.2-1, P belongs to exactly 2n 
maximal chains, kı, ka,’ - ', kan, where 'n = 1 if P is a regular point. Suppose 
the maximal chains have been: labeled so that kı and ky, have the branched 
curve b; in common and b, by, are clockwise adjacent, t==1,2,-.- -,2n 
(mod 2). . 

We now define a mapping of a TEN, neighborhood of P onto an n-fold 
covering of 0<|z|<1. Each chain k; lies on the boundary of exactly 
one region R, and there is an associated homeomorphism A; defined in 
Section 3.5.1 of k; U R; onto the strip Sy < 1, —% < T <%, with curves 
of G[k U Ry] going onto line segments connecting points on y—=0 and y—1. 
Let P; be a point of b; and s; == h> (y =c), 0<¢ <1, be a curve of FUR] 
for each i. Let g; be the arc of @(P;) between P; and s, gẹ be the arc of 
@(P;) between P; and suy +==1,2,---,2n (mod 2n), and let Ry’ be the simply 
connected region bounded by ki gs, g’¢1 and s Then hy maps Rj onto a trape- 
zoidal region bounded by y = 0, y =— c, h(g,) and (g's). If necessary modify 
hy by a reflection in the y-axis so that the positive direction on k; corresponds 
to the positive direction on the z-axis under hy. Now we map h (Ré ) onto 
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a rectangular region by a homeomorphism hj’. Let h(P)—= (2,0), 
W(P) = (21,0), u(P;) = (2,0) and for each point (x,y) of Ay(Ry’) let 
(z”’,0) be the endpoint on the z-axis of the segment through (z,y) which 
corresponds under Air! to a curve of G[R,]. Define hi’ (z, y) to be the point 
‘(z’,y’), where — a 


L =m (£o — 2") /(2,— 2), 2” between zo and t, 
a’ = (#’—12,)/ (Ta —2%,),2” between T, and T, 


if the direction from P}, to P; on k; is positive; otherwise 


a! = (m — T”) / (to — 11), 2” between T, and ti; 
T= (£ — To) /(To— T), £” between x, and zz. 


Let y = y/c if i is odd, y’ =— y/c if i is even. Now follow hy’ by a mapping 
hi’ such that hi” (z,y) = (x,y), where y =y and 2’ is the z-coordinate of 
Kiarhiihith' r (a, 0) for « between 0 and hyhi(P,1), 2’ — z for z between 0 
and hihi (P:i), i=l, 2, 68, an (mod 2n). Let fi— hihihi. Since the maxi- 
mal chains of F have been consistently oriented, f; is a homeomorphism which 
coincides with fi. along the arc of b, from P to Pi. i 

Let V, be the image under fi of the upper half of |z| 5&1 if ¢ is 
odd, the lower half of |z| S1 if i is even. Then the homeomorphisms 
fofa’ © ‘> fan together with the regions Vi, Va,’ © *, Van define an n-fold 
covering of 0 < |z| S1 by a deleted neighborhood of P. The subsequent 
map zU/» will then complete the mapping of V = V, Ú V,U +- - U Van onto 
O< |z| <1, the curves of G[V] going into arcs of Re(z") = constant, P 
going into 0.: Hence P is a branch point of G of order n if n > Ł, a regular 
point of G if n==1. Therefore @ is a branched regular curve family com- 
plementary to F. . 


8.5.8. Some properties of G and v. First we verify that each regular 
curve or infinite chain c of @ tends properly to infinity relative to F. Since 
the trees of F are isolated, if c intersects an infinite number of trees of F in 
a given direction, then c tends properly to infinity in that direction. If ¢ 
intersects but a finite number of trees of F in a given direction, then, since 
it can intersect a given tree at most once, it tends to infinity in a region R. 
By the definition of G, R has but one boundary chain, and c tends properly 
to infinity in R. 

Next we verify that |v| tends to o in each direction on each element 
of F and tends to no finite limit on any infinite chain of F. By definition, 
|v | tends to œ in each direction on a maximal chain of F. If c is a regular 
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curve of F, then c lies in a region R and every curve of @ which intersects 
a given boundary chain & of R also intersects c. Hence |v | tends to œ on e 
in each direction. Suppose c is an infinite chain of F. Since v differs by 
+1 at the endpoints of a branched curve, v tends to no finite limit on a 
chain on which the branch points tend to œ in both directions. If the 
branch points on c do not tend to infinity in a certain direction, then beyond 
a certain point c consists of a single branched curve b and |o | tends to co 
on b, hence on c. 

Finally we show v is an allowable function contoured by G. Properties 
(1) and (2) follow from the definition of v. Suppose z is a cross-section 
of @ contained in a region R. Each curve of G which intersects z also inter- 
sects a boundary chain k of R. Since v is monotone on k, it is also monotone 
on z. Suppose x is a cross-section of. G which intersects two adjacent regions 
Rand S. Let R and S have the common boundary curve b. Since v is a 
cross-section of G and @ is complementary to F, 7b is a regular point P 
of F. Let V be the neighborhood of P described in Section 3. 5. 2 (n= 1). 
Then each curve of @ which intersects «N V also intersects b and since v 
is monotone on b, v is monotone on z N V. Hence v is monotone on zg. 


8.6. The main sufficiency theorem. 


THEOREM 3.6-1. Suppose F is a branched regular curve family, the 
trees of F are isolated and F contains no b-curve. Then there exists an 
analytic function the real part of which is contoured by F which has no finite 
asymptotic value. 


Proof. Let u, v and @ be defined as in Sections 3.4 and 3.5. Suppose 
c is a path which tends to infinity from a fixed point P. If c intersects an 
infinite number of trees of F, then lim sup |u |=% on c. 


_ Suppose c intersects one tree T of F in an unbounded set of points. 
Let M and N be two points of intersection of c and T. There is a unique 
chain k of T connecting M and N. If M and N are both points or end- 
points of a single branched curve b, then, since v is monotone on b and con- 
tinuous on c, v assumes every value on c it does on b between M and N. 
Suppose % contains branch points between M and N. In going from M to N 
on k, suppose B, is the first branch point encountered beyond M and let M 
and B, lie on the closure of the branched curve b,. Let m, be the mixed 
maximal chain through B, determined by b,. The chain m, separates M 
and N, so c intersects m, in a point P,. The chain connecting M and P, 
is part of a maximal chain k,. Since v is monotone on k, and continuous on c, 
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v assumes every value on c between Af and P, that it assumes on k between 
| MW and B,. Let B: be the next branch point beyond B, on k and P, a point 
in which c intersects the mixed maximal chain through B, determined by 
the branched curve B,B.. Again it follows that v assumes every value on c 
between P, and P, that it does on & between B, and B,. Continuing in this 
manner, we conclude that v assumes every value on c between M and N that 
it does on the chain & between M and N. In particular if there are at least 
two branch points on k between M and N, then v assumes values on c between 
M and N which differ by an integer. Hence if the set S of branch points 
on chains connecting the intersections of c and T is unbounded, v tends to 
no finite limit on c. If 8 is bounded, then c will intersect one branched 
curve b in an unbounded set of points, and in this case lim sup | v| will tend 
to œ on c. 

If c intersects no tree of F in an unbounded set of points and c intersects 
at most a finite number of trees of F, then c tends to infinity in a region R. 
If R has only one boundary chain and c intersects each curve of F[R], then 
lim sup | u | © on c. Suppose c does not intersect a curve s of F[R], 
where R may have two boundary chains. Then c tends to infinity in the 
region bounded by s and a boundary chain k of R. Let c intersect a regular 
curve g of G[R] and let Q=gNk. Then c intersects each curve of G(k) 
beyond @ in at least one direction on k. Hence limsup|v|—o onc. A 
similar argument shows that lim sup | v | =œ on c if R has two boundary 
chains and c intersects each curve of F[R]. Hence we conclude that the 
function f==u-+ w is an allowable function contoured by (F,@) which has 
no finite asymptotic value. The theorem now follows by the remark at the 
end of Section 1.2.8. 


Note. The only property of v and G used in the proof of Theorem 3. 6-1 
which is not included in the hypothesis of Theorem 3. 5-1 is that v differs by 
+1 at the endpoints of a branched curve, and this property is only used 
when the set of branch points on chains connecting the intersections of the 
path c and a tree T is unbounded. 

As a consequence of Corollary 2.2-2-1 and the observation following it, 
we obtain the following corollaries. 


COROLLARY 3.6-1-1. F contours the real part of an analytic function 
with no finite asymptotic value if the trees of F are isolated and F contains 
no cyclic set V containing three or more elements such that 6(V) contains 
no branched curve. 
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COROLLARY 3. 6-1-2. F contours the real part of an analytic function — 
with no finite asymptotic value if the. trees of F are isolated and- each regular 
curve or maximal chain of F tends properly to infinity relative to some family 
DUDEN to F. 


8.7. Curve families and conjugate nets contouring polynomials. 


Lemma 3.7-1. If F has at most a finite number of branch points and 
contours the real part of an allowable function w= f(z) =u +w which has 
no finite asymptotic value, then f is topologically equivalent to a polynomial. 


Proof. By Theorem 1.2-9, f is topologically equivalent to a function g 
analytic in x or in |z| <1. We define f(co) =co and shall then show that 
` f is a light interior mapping of the extended plane onto the extended plane. 
Hence by Stoilow’s theorem [12, p. 121], f is topologically equivalent to an 
analytic mapping g of the extended plane onto the extended plane. We can 
leave oo fixed under the homeomorphism relating f and g, so that g(o) =o 
also, and g has no other pole. Hence g is a polynomial. 

We first show f is continuous at œ. Since f has no finite asymptotic 
value and u is monotone on any regular curve or maximal chain of G, |u| 
tends to œ in both directions on any element of G and the same holds for v 
on elements of F. It follows that the locus |f| = N is bounded in any region 
R. Since there are but a finite number of regions the locus |f|SN is a 
closed bounded subset of m. Therefore the inverse image of the set in the 
w-plane |w| > N is an open set containing zo». Hence f is continuous 
at oo, Also from the monotonicity of Re(f) and Im(f) on cross-sections of 
F[R] and G[R] respectively for each region R, it follows that f assumes a 
given value at most at a finite number of points of =, hence f is =; and 
that each point of the extended w-plane is.covered by f. 

The function f is interior at each finite point since it is an allowable 
function. Fixr>0 and let p=»max|f(z)| for |2|<r. Then for each w 
in |w] > p there exists a z such that f(z) =w by the preceding paragraph; 
furthermore |z| >r. Hence the image of any neighborhood of z= con- 
tains a neighborhood of w==0, so f is interior at œ also. 


COROLLARY 3. 7-1-1. If (F,@) is a conjugate net, F has at most a finite 
number of branch points and (F, G) contours.an allowable function f = u + iv 


which has no finite asymptotic value, then f is topologically epunalent to @ 
polynomial. ya 
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- THEOREM 3.7-1. Necessary and suficient conditions. that a branched 
regular curve family F contour a harmonic polynomial are that F contain at 
most a finite number of branch points and no b-curve. 


Proof. The necessity follows.from Corollary 2.1-1-1 and the fact thet a 
polynomial has at most a finite number of critical points, hence the corres- 
ponding level curve families of the real and imaginary parts of the polynomial 
have at most a finite number of branch points. 

"Define u, v and G as in Sections 3.4 and 3.5. Then f=-u-+w has no 
finite asymptotic value and is topologically equivalent to a polynomial g by 
Lemma 3.7-1. Hence F is homeomorphic to the level curve family of Re(g) 
or Im(g). 


THEOREM 3.7-2. If F contains at most a finite number of branch points, 
G ts complementary to F and each regular curve or infinite chain of G tends 
properly to infinity relative to F, then (F,G@) contours a polynomial. 


Proof. Since each curve @ tends properly to infinity relative to F, F 
and G contain no b-curves as a consequence of the note following Theorem 
2.1-1. Hence by Theorem 3. 7-1, F is homeomorphic under a homeomorphism 
h to the level curve family of a harmonic polynomial u. Let v be a har- 
monic conjugate of u, G’ be the family of level curves of v and G” be the 
image under h of @. Then Q” is complementary to F, and the conjugate 
net (F, G@”) contours an allowable function f =u’ + iv’ which is topologically 
equivalent under h to the polynomial u -+ iv. Hence f has no finite asymptotic 
value. Suppose c is a regular curve or infinite chain of G. Since F has at 
most a finite number of branch points, c tends properly to infinity in a region 
R. Hence f[R]=F(enR). Since (F,G”) contours a function with no 
finite asymptotic value, each element of G” tends properly to infinity relative 
to F, and by Theorem 3.1-2, there is a curve z of @” such that F[R] 
=F(enR)—=F(zNR). Therefore, since |w’ | tends to œ on sN R, |u| 
also tends to œ on cN R. By interchanging the roles of F and G it follows 
that there is a function v” contoured by @ which is topologically equivalent 
to a harmonic polynomial and |’ | tends to œ in both directions on any 
element of F. The families F and G and the functions u’ and v” satisfy the 
hypotheses of Theorem 3. 5-1, hence as a consequence of the note following 
Theorem 3. 6-1, w -+ tv” is an allowable function contoured by (F, G) which 
has no finite asymptotic value. By Lemma 3.7-1, w + iv” is topologically 
equivalent to a polynomial. 
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Note. The hypotheses of Theorem 3.7-2 are also necessary conditions 
that (F,@) contour a function topologically equivalent to a polynomial. 
Hence the hypotheses of Theorem 3. 7-2 characterize the conjugate nets which 
contour a polynomial, while the hypotheses of Theorem 8.7-1 characterizes 
the curve families which contour a harmonic polynomial. 
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DIOPHANTINE APPROXIMATIONS ON TORUSES. P 
By Serez Lane. 


The main purpose of this paper is to make precise certain analogies 
between diophantine approximations on the multiplicative group and elliptie 
curves, and to show how these are related with approximations on the additive 
group by means of the exponential mapping. We shall state two conjectures. 
To relate their exponential and logarithmic formulations, it is best to prove 
first some results relating the exponential and logarithmic heights. 


1. Heights on the multiplicative group. Let K be a number field, 
and let Mx be the set of absolute values on K extending the standard, nor- 
malized absolute values on the rational numbers Q. (cf. [3], Chapter III.) 
If | [e is in Me, and a is an clement of X, we write 


v(a) =log || a | 


where | a [o= |«|,Y”. Instead of saying that | |, is in Mx, we shall also 
say that v is in Mx. By the product formula, we have 


Sola) = 0 


for any a€ K* (= multiplicative group of K). If (a+. -,@,) is a point 
in projective n-space with coordinates in K, we define its height to be 


Zup(0, v(m)). 


(This is the logarithm of the height as used frequently in the past literature.) 
If P is the point represented by (a,---,@,), we shall write A(P) for its 
height (again taking the log of the notation in [3]). If a is an element of 
K, we let h(a) be the height of the point (1,«) in- projective 1-space. 

We shall use the standard Vinogradov notation for orders of magnitude. 
Tf ¢, y are two real functions on a set, whose values are > 0, we write 6 << y 
if there exists a constant c>0 such that <a. We. write $>><<w if 
b<<p and vice. 

Let T be a finitely generated “subgroup of the multiplicative group K* 
of K. There exists a finite set S D Se of absolute values in M x, such that T 
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is contained in the S-units Ks, i.e. those elements of K* having absolute 
value equal to 1 outside S. Let s+ 1 be the cardinality of 9, and map 


L: Ks> Re 
by the log, such that 
E(B) = (0:(B),° * vn(B)); 


if oj are the elements of ©. The kernel of L consists precisely of the roots 
of unity in K. The image of L is a lattice of dimension s in the hyperplane 
H defined by the equation , 


8+1 


> Tj am 0. 
ja 
We now define a function F on R**! by the condition 
etl 
F(X) —2 sup (0, 2). 


Then for any t= 0 we have F(tX) = tF(X), and for any two vectors X, Y 
we have F(X + Y)SF(X)+F(Y). We view F as restricted to the hyper- 
plane H. Then for X in H, the condition F(X) 0 implies X == 0. Finally, 
for X in H, we have F(—X)—F(X). Hence F is a norm function on H, 
and in particular, induces a norm function on any subspace of H. 

The image of T under L is a discrete subgroup of R**. Let W be the 
vector space generated by this image. Then L(T) is a lattice of maximal 
rank, say m, in the vector space W. Let B,,---,By, be a basis of L(Y). 
For any vector X in W, we can write 


X =y4B +: > + YmBa 
We define 
G(X) = sup | y|. 


‘Then G is a norm on W. Since two norms on a finite dimensional vector 
‚space are always of the same order of magnitude, we conclude: 


Proposirion 1. We have F>><<G on the space W. 


Let Bı’ ` ‚8m be free generators of r modulo its torsion group. For 
‚each ß in T we can write 


B= fi" + + Bm’er 


‘with suitable integers vı,’ ` -,v, and a root of unity r. Define 


ye=y(8) =a sup | n |. 
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From Proposition 1, we obtain immediately the 
COROLLARY. As functions on T, we have v>><ch. 


We shall now give an asymptotic formula for the number of units of 
bounded height. This amounts to counting lattice points in certain regions. 
It seems to me that for such problems, the criterion given by Davenport in 
[1] is rather hard to apply, and that it is better to proceed as follows. One 
proves that the boundary of the region can be parametrized by a finite number 
of unit cubes whose dimension is smaller than that of the region, For 
homogeneous problems, one can then use the following result. 


Propostion 2. Let:D be a bounded set in R™ and assume that its 
boundary ts contained in a finite union of pieces, each of which is the image 
of the unit (m—1)-cube under a mapping satisfying a Lipschitz condition. 
Let A be a lattice in Rm of dimension m. Then for t>o, the number of 
lattice points in tD is equal to 


Vol D m 
vir Tee 





where Vol means volume in R™, and F ts a fundamental domain for the lattice. 


Proof. We recall that the boundary is taken in the sense of point set 
topology. It is the set of points having arbitrary small neighborhoods inter- 
secting both the set D and its complement. 


Let à * *, Àm be a basis for A over Z, and let F be the canonical funda- 
mental domain consisting of all vectors 


tdi fb: + > + tad, 0S%<1. 


Tf à is an element of the lattice, and if the translation Fy of F intersects tD 
but is not contained in tD, then F, intersects the boundary of tD. To see 
this, let a be a point in FANtD and let b be a point in Fy but not in 
tD. Since Fy is convex, the line segment between a and b is contained in Fy. 
There exists at least one point on this line segment which intersects the 
boundary of iD. Indeed, if a is an interior point of tD, we consider the set 
of points on the segment lying in the interior of tD. It is non-empty and 
open. If no point of this segment lies in the closure of ¿D but not in the 
interior of tD, then our set is also closed, contradiction, since the segment 
is connected, and b lies outside tD. 
Let: 
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n(t) <-number of translates Fy contained in tD, 
n’(t) = number of translates Fy intersecting ED, 
b(t) =number of translates F) intersecting #(tD). 


Then OXn’(t) —n(t) S(t). Each translate F\ of F contains precisely 
one lattice point, namely A. If we can prove that — 


b(t) =0 (t">), 
then the assertion of the proposition follows at once from the inequality 
Vol(F)n(t) S Vol(tD) =t” Vol(D) S Vol(F)n’(t). 


We now prove that b(t) << te. Let g: I" R" be a mapping of the 
(m—1)-cube I” satisfying a Lipschitz condition, and parametrizing one 
piece of the boundary ôD. Since 0(tD) —=19(D), the map tg parametrizes 
the corresponding piece of 6(¢D). It suffices to prove our assertion for this 
piece. Cut up the sides of J”-* into intervals of equal length 1/[t]. This 
determines a partition of I"! into << #1 small cubes, each such small cube 
having a diameter <c,/t for some constant cı. The image of such a small 
cube under g has diameter <c,/t (where cz is equal to c, times a Lipschitz 
constant for g). Hence the image of such a small cube under tg has diameter 
= ts. Hence such an image meets only a bounded number of translates Fy 
of our fundamental domain. Since we have at most cst"? small cubes, we 
have proved our assertion. 


Note. It would be a useful criterion if one knew that a compact subset 
of a real algebraic set in R” of algebraic dimension < m satisfied the hypo- 
thesis of Proposition 2. Because of the singularities, it does not seem easy 
to prove, and is one source of hand-waving in the literature. Added in proof: 
I understand from Hironaka that he can prove this statement. 

We shall apply Proposition 2 to count units in. number fields. 

Let 8 be a finite subset of Mx containing the archimedean absolute values. 
Let s + 1 be the cardinality of S, and let Kg be the S-units, i.e. the element 
of K* whose absolute value outside 8 is equal to 1. Then Kg modulo a finite 
group of roots of unity is a free abelian group on s generators. 


PROPOSITION 3. Let T be a finitely generated subgroup of Kg. For each 
t > 0, let nr(t) be the number of elements of T whose height is St. Then 
there is a constant c>0 such that 


nr (t) = ein + O (1) 


where m is the rank of T. 
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Proof. As before, we map Kg into Euclidean (s+ 1)-space R by the 
log mapping: 
L: Kg R!” 
such that 


L(B) = (m8) ` tss (8))> 


if vj are the elements of S. The kernel of L consists precisely of the roots 
of unity in K. The image of L is a lattice of dimension s in the hyperplane 
H defined by the equation 


atl 


Er 0. 


J 
Let D(t) be the region consisting of points (2,,° * `, Ssa) contained in the 
hyperplane, and satisfying the relation 


8+1 


Ssup(0,2;) St. 
3-1 


Then D(t)==tD(1), and up to a root of unity, the elements of Kg of height 
< t can be identified with the lattice points contained in D(t). The set of 
vectors X in the hyperplane such that no z; is equal to 0 and 


s+1 
Sep (0,4)) <1 


is open in H. Hence the boundary of D(1) consists of the vectors X in D(1) 
satisfying 

8+1 

py sup (0, 2;) =i, 

j=1 


except for pieces where some z; = 0, which can be dealt with by induction. 
Let T denote a subset of S (identified with the integers 1,- --,s-+-1) which 
is neither empty nor equal to S. The points (2,,° * -,2s41) satisfying 


T Z0, del and 2,50, }a,——1 
peT BET 


are contained in the boundary, and the boundary is the union of such sets 
of points as T ranges over subsets of S as above, together with pieces with 
some z;—=0 which can be dealt with inductively. 

Let W be the subspace generated by the elements of T over the real 
numbers. Then T is a discrete subgroup of W, of rank m, i.e. T is a lattice 
of maximal rank in W. We also observe that W is a subspace of H. Let 
Dy(t) =D(t) NW. The interior (open) of D(t) intersected with W is 
open in W. Hence the boundary of Dy(t) is contained in the intersection 
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of the boundary of D(t) and W. Since Dy(t) —~tDy(1), we are led to 
considering the finite union of pieces described by a set 7’ as above, intersected 
with W, and we must show that each one of these can be parametrized by an 
(m —1)-eube. If we can do this, we can then apply Proposition 1 to con- 
clude our proof. 

_ Without loss of IR say that T consists of the first 2 coordinates 
' for some integer p. Let 


B=(1,---,1,0,---,0) and B’=(0,--*,0,1,-- -,1) 


be the vectors having coordinates equal to 1 in the first p places (resp. the 
last s-+-1—p). Let ,—B-+B’. Then H is the hyperplane perpendicular 
to Ag. We can find vectors 4, ` ` -Asm in H such that Ao, Ai: - +,dom 
are mutually perpendicular, and such that W consists of all vectors of H 
perpendicular to Ay,---:,Asm. Let E be the set of vectors X such that 


X:B=1 and XB’ =— 1. 


Then D(1) is contained in #, and is obtained from # by imposing additional 
inequalities, namely z,=0 for v€ T and 2,<0 for „ET. The intersection 
E A W is the set of vectors X such that: 
ZX: B=1, X: B' =i, X-Ay—=0,- 0 +, X:Agm— 0. 

We must now consider two cases. 

Case 1. The vectors B, B’, A,,: ' ',Asm are linearly independent. 
Then E is the translation of an (m —1)-dimensional space, and applying the 
additional inequalities to Æ yields an (m —1)-dimensional closed, bounded 


intersection of planes and half-planes which can be parametrized by an 
(m—1)- cube. (We leave it to the reader to select some parametrization.) - 


Case 2. The vectors B, B’, A © +,Asm are linearly dependent. Since 
Ao,’ + *,Agm are mutually perpendicular, and A, == B -H B’, there exists 
numbers b, a,,' "50m such that 


B’—bB+a,4,+:- "+ Ge mÄsm- 
Let X be in EN W. Taking the scalar product with X, we obtain 
X + B’ me —L=b. 


Hence B+ B’ =A, is a linear combination of Aas Am whieh is 
impossible. We conclude that in Case 2, the intersection ÆN- W is empty, 
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and the intersection of the boundary of D(1) with W corresponding to the 
piece relative to T is empty. 

In both cases, we see that dD(1)N W admits a parametrization by an 
(m—1)-cube. Thus Proposition 1 is applicable and Proposition 2 is proved. 


(Note. The analogous counting theorem: for elements of K of bounded 
height is considerably harder to prove, and has been done by S. Schanuel 
in [4].) 


2. Approximation on the multiplicative group. Let @ be the multi- 
plicative group. Let T be a finitely generated subgroup of Gx, where K is a 
number field. Let ¢ be a non-constant rational function on G, defined over 
K, and let r be the maximum of the multiplicities of its zeros on @ (so distinct 
from 0 or ©). Let m be the rank of T. 


CONJEOTURE 1. The height of points P in T which are bounded away 
from 0 and © and satisfy the inequality 


(1) |#(P)| << pgp («> 0) 
is bounded. 


We shall transform inequality (1). The function field X(@) is generated 
by a single function, and & can be viewed as a rational function. .A point P 
is represented by an element of K, say ß, and if #(£) is small in absolute 
value, then there is some root «340 of the rational function ¢ such that £ is 
close to a. If 8 is close to a, then its distance from any other zero or pole 
of & is bounded away from 0 (approximately by the distance of « itself from 
another zero or pole). The multiplicity of œ in a factorization of ¢ is at 
most r. The worst possible case is that in which this multiplicity is r. In 
that case, |¢(f)| is approximately equal to |a—£ß|" (up to a constant 
factor). Hence our inequality amounts to 


- j ‘ 1 
%— o. 
If one replaces h(8)™e by e*@« in the right hand side of our inequality, 
then the statement is actually a known theorem of Mabler (cf. for instance 
[3], Corollary of Theorem 1, Chapter VI, §1). 
The above approximation can be transferred to the additive group. Let 


Bi? © +, 8m be free generators of T modulo its torsion group (i.e. the group 
of roots of unity). Then we can write 
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Bm Bi": + + Bar 


for some torsion element r. Furthermore, |«— | is of the same order of 
magnitude as |logza—logf|. Since r ranges over a finite set, in dealing 
with solutions of the inequality (1), we may assume that we have always 
the same r. Let w-=log(ar). Taking the corollary of Proposition 2 into 
account, we may rewrite our inequality in the form 


s 1 
| to — v1 log Bi —' ` < — vm log Bm + Ymar | << prise? 


where the log is one fixed value of the logarithm. 

We have therefore transferred our diophantine approximation on the 
multiplicative group over a number field into an inhomogeneous approxima- 
tion on the additive group. The period Ari of the exponential function con- 
tributes one term to the sum on the left, and gives rise to m +1 free choices 
of the coefficients v1," © *, Yma. A standard application of Dirichlet’s principle 
shows that m cannot be replaced by a smaller exponent on the right hand side. 
In fact, given real numbers é,---,ém and an integer v>0, there exist 
integers vı,” > +, ¥%m not all 0, such that 


1 
| né +: i + En | << pew 


and |y |&v. (This has content of course only when £,’ ` -, £m are linearly 
independent over the rationals.) Hence the exponent rm in the conjecture 
cannot be improved upon. 

Khintchine’s theorem and suitable generalizations by Schmidt ([5] 
Theorem 2) imply the following: For almost all sets é,'' -,é&s,7 of real 
numbers the solutions of the inequality 


1 
|o H ré tH + men | << ynie 


(where y= max | x; |) are finite in number. Thus our conjecture essentially 
asserts that the logarithms of algebraic numbers behave like “almost all 
numbers”, It may be viewed as expressing a measure of linear independence 
for logarithms of algebraic numbers. One conjectures of course that log fi, 
- ++, log Bm are in fact algebraically independent, and one could make an 
analogous conjecture for their measure of algebraic independence. 

Actually, in view of the fact that the period of the exponential is pure 
imaginary, namely 2rt, the approximation in its additive form separates into 
two simultaneous approximations, concerning the real part and the pure 
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imaginary. If uo, logßı,' © -,log Bm are all real, then to get a small number 
on the left hand side of our inequality, we must have vm ==0. In that 
extreme case, the exponent m will be wasteful, and should be replaced by 
m—1. 

Gelfond [2] has obtained transcendence measures for quotients of log- 
arithms of algebraic numbers which improve the Mahler result in that case, 
for instance of the type 


1 
[vloga -+ vrelog 8 |>> sean 


for algebraic «, 8 multiplicatively independent. This is still far short of 
what is to be expected, but Gelfond’s clever method might be a step in the 
right direction. In any case, it is a first indication that the Mahler result 
is a priori too coarse. 

I have had some preliminary computations comparing the absolute values 
of expressions of type 


| n log 2 -+ ve log 3 + vg log 6 | 


with 1/»** (letting v = max |»; |), and e==1/4. They were carried out only 
for v=50. They seem to indicate a tendency for the solutions to thin out, 
but one should carry them much further to get a significant computational 
support for the conjecture that there is only a finite number. 

Actually, the computations suggest one other possibility. For each r, 
let y (v) be the number of solutions of the inequality 


| vlog Bs ++ > -mlog By |S Sa, |u| Sv 


where 8,,° ' `, Bn are, say, real algebraic numbers. Then in the above case, 
except for v1, the values of y(v) were 1, 2, or 3. Thus there is a vague 
possibility that y(v) might be bounded. It would also be interesting to push 
the computations quite far, to see how y(v) behaves asymptotically. Especially 
for this function, y ranging up to 50 cannot be regarded as really significant. 


3. Heights on elliptic curves. Aside from the additive and multiplica- 
tive groups, the only other group variety of dimension 1 is an elliptic curve. 
We shall be interested to the analogues of Proposition 3 and Conjecture 1 
for such curves. In this section we deal with the analogue of Proposition 3, 
and I shall reproduce results of Tate (unpublished at the moment, as usual). 
It will in fact be just as easy to work on abelian varieties. 
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Two functions on a set will be called se if aor ra is 
bounded in absolute value. 

THEOREM 1. (Tate) Let A be an abelian Be in projective En 
defined over the number field K. Then there exists a unique ‚positive. definite 
quadratic form q and a linear form l on Ak such that h is ar to 
q+, as functions on Ar. 


Proof. We consider. the function f on AXA given by f(P,Q) 
—h(P + Q)—hA(P)—h(Q). We contend that as a function of each variable, 
f is essentially linear, i.e. for all Pı, Pa, Q the expression 


| #(Ps t+ Ps Q) —} (P30) —f (Pr) | 
is bounded. This expression is equal to | 


|h(Pi + Pa +Q) —h(P1+ P2) —h(P1+Q) iA 
—h(P2t+ Q) +h(Pi) +h(P2) +h(Q)|- 


Let pı: Á X A X A — A be the sum. Let $.. be the composite map 


Tig rE: 
AXAXA——AXA——A 


where 72 is the projection on the first two factors and s, is the sum, and define 
dis, des Similarly. Let & (¢==1,2,3) be the projection on the i-th factor. 
Let H be a hyperplane section giving the projective embedding of A and the 
height. Then by the theorem of the square, 


Piss (H) — $127 (2) — u (1) a das? (H) 
+ $17 (A) +p (A) + $37 (4) 


is linearly equivalent to 0. It is a divisor on AX A X 4, and the height 
associated with this divisor is therefore equivalent to 0, by one of the main 
properties of heights (cf. [3], Property 3, Chapter IV, §2). This height 
is precisely the function expressing the linearity of fi in the ‚rst variable. 

We now define 


(P,Q) =lim z f(O*P, 29). 


It is a trivial exercise to verify that 6(P,Q) is actually ARI and is equiv- 
alent to f (P,Q). 

We let g(P) —=3b(P,P). It is a trivial exercise to verify that h—g is 
equivalent to a unique linear functional I. This it follows that h is equivalent 
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to g-+1. . Since the height is always = 0 and there is only a finite number 
of points with bounded height, it follows that g is positive definite. The 
uniqueness statements are trivially proved. 


CororLary 1. (Tate) If the hyperplane section H of A giving the 
projective embedding satisfies H == H- (transform of H under the automor- 
phism P~ — P of A), then the linear function 1 is equal to 0. 


Proof. Easy exercise, using the theorem of the square. 


COROLLARY 2. Let T be a finitely generated subgroup of Ax. Let 
Py, + c, Pm be free generators of T modulo the torsion group, and for each 
Pin T, write l 


Peer IE EEE MEN, 


where Q is an element of the torsion group. Let v=v(P)=max|»|. As 
function on T, we have h>><<v’. 


Proof. Obvious. 


COROLLARY 3 (Neron). Let T be as in Corollary 2. The number of 
points P in T such that g(P) St ts equal to 


cll? +. O (12) . for tw 
and some constant c > 0. 


Proof. In the case of & positive definite quadratic form q on T, we can 
view g as defined on the tensor product of T with the real numbers, and the 
condition of parametrizability stated in Proposition 2 is satisfied in the present 
situation; because the unit’ sphere relative to the quadratic form is a compact 
submanifold of dimension m —1 in m-space. i 


4. Approximation on elliptic curves. Let A be an abelian variety of 
dimension 1 defined over the number field K. We can represent A (or rather its 
complex points) as a quotient of the complex 1-space, say by means of a 9- 
function associated with A, with gs, ga in K. If u is a complex number, we 
denote by exp(u) the point whose projective coordinates are (1, 9 (u), P’(u)). 
Conversely, if P is a point on A, we let logP be some fixed u such that 
exp(u) == P (we choose u in a fixed, bounded fundamental domain). 

Let ¢ be a non-constant rational function on A, defined over the number - 
field K and let r be the maximum of the multiplicities of its zeros. Le T be 
a finitely generated subgroup of Az, of rank m. 


5 
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CONJEOTURE 2. The height of points P in T which satisfy the inequality 


1 
lo(P)| << = ep yar 
is bounded. 


If one replaces the right hand side of the inequality by eXP«, then it is 
known that there is only a finite number of P satisfying the corresponding 
inequality. This is essentially the formalization of one step in the Siegel 
argument that an elliptic curve has only a finite number of integral points, 
taking Roth’s Theorem into account (cf. ‘Theorem 1 of [3], Chapter VII, §1). 

The rational function ¢ may be viewed as a doubly periodic elliptic 
function, so that we have ¢(P) = @(u), for u complex. Since the complex 
points of A form a compact set, any infinite sequence of points P whose 
height tends to infinity and satisfies our inequality must have a point of 
accumulation P which will be a zero of ¢. The worst case from our point of 
view is when & has a zero of order r at Py. In that case, has a power series 
expansion near u= log P, given by l 


(u) = c (u — to)" + 
for some constant c, 0. 
Let P,,' - +, Pm be free generators of Ax modulo the torsion group. Let 
w=logP;. Let o w, be two fundamental periods. Let 
P= Pi + + + Pat 


where Q is in the torsion group. Without loss of generality, we may assume 
that we always have the same point Q, for P satisfying our inequality. Then 
P is close to Po, and there exist integers vais, Yma such that 


Vater ee Ymm Emr + Vinsa 
is close to up—log(P,—-@). Hence our inequality amounts to 


u + rnu p: `F Vmin F Yansıwı F rics | CC LTE 


‘This is an inhomogeneous approximation problem near uy. By Tate’s theorem, 
h and +? are of the same order of magnitude (letting v as usual be max |» |). 
Hence our inequality may be rewritten as 


| —ı 4 Wty fei + Yan F rmn F Pmst | “< sae 


petite” 
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Thus our conjecture asserts that from the point of view of diophantine approxi- 
mations, the logs of algebraic points on our elliptice curve behave again like 
“almost all numbers”. 

Actually, the two periods wœ, and w: are linearly independent over the 
reals. This would seem to indicate that the exponent m-+1 should be 
replaced by m, just as for the multiplicative group. This also raises the 
following question. Given a non-zero period w, are there infinitely many 
real values of ¢ such that P (fo) are algebraic and linearly independent over 
the integers? The extent to which m can be further lowered depends on the 
existence of such values of t. 
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INVARIANT DIFFERENTIAL OPERATORS AND DISERIBEIIONS 
ON A SEMISIMPLE LIE ALGEBRA. 


By HARISH-CHANDRA. 


| 

1. Introduction. This paper deals with the second main step in the 
proof of Lemma 1 of [2(d)]. As indicated in [2(d), p. 121] this proof 
proceeds by induction on dimg. Let H be a semisimple element of g and 4 
the centralizer of H ing. Then dim3 < dimg if H is not in the center of g. 
In this paper we give a method of reducing.the problem from g to 3, locally 
around H. Since the induction hypothesis is applicable to 3, this enables 
us to resolve the question around H. Even when g is semisimple, 3 is only 
reductive and therefore, in order to permit induction, we are forced to start 
from the assumption that g is reductive rather than semisimple. 

The basic tools for effecting the above-mentioned reduction are contained 
in Lemma 17, its corollaries and Theorem 2. The proof of Theorem 3 provides 
a good illustration of how our method actually works in practice. 

This work was supported, in part, by a grant from the Sloan ee 
and a contract with the U.8. Army. 


2. Some algebraic oiie: Let k be a field of characteristic zero and g 
a Lie algebra over k. We use the notation of [2 (e), 886-7]. If n—dimg, 
we can select pE P(g) (0Si=n) such that 


det(t—ad I) = Z p(X)" (Xeg) 


for an indeterminate t. Note that p,==1. Let! be the least integer such that 
pı7%£0. Then J is called the rank of g and an element Y€g is called 
regular (in g) if p(X) 0. Similarly X is singular if p(X) —0. 

Now assume that g is reductive and 3 is a subalgebra of g such that 
1) 3 is reductive in g and 2) rankg—rankg. Put 


£(Z) = det(adZ)g/, (Ze 3), 


where (adZ),,, denotes the endomorphism of the factor space g/g defined by 
adZ. Let 3’ be the set of all Z€ 3 where £(Z) 540. Since 3 is reductive 
in g, we can select a linear subspace q of g such that 1) g —3 -+ q, the sum 
being direct and 2) [3,q] C q. 
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Let c be the center and g, the derived az of g. -Then g, is semi- 
simple and g is the direct sum of g, and c. 


Lexma 1. q is the set of all Ye gı such. that ee aaa for 
every Z€ 3. Moreover (540. 


For the proof of this lemma, it is clearly permissible to extend the ground 
field k to its algebraic closure. Hence we may assume that k is algebraically 
closed. Fix a Cartan subalgebra 5 of 3. Since rank 3 = rank g; Ņ is also a 
Cartan subalgebra of g. Let Q be the set of all roots of (g,). For any 
a€ Q, select an element Ya340 in g such that [H, Ya] —a(H)Xq for all 
Heg. Then since [b,5] C 3 and [b, q] C q, it is obvious that 

=h -H E Xa, ge hie 
acQı @EQs 
“where Q. is the set of those a€ Q for which Ya€ 3 and Q: the complement 
.o£ Q, in Q. Since 3 is reductive, it is obvious that Q,, and therefore also Q3, 
are stable under the mapping a—»—<a of roots. Since Xa€ gı («E Q) and 
since X. is orthogonal to 


b+ = Ki 
BedBA-a 


under the Killing form, while tr(ad Yaad Xa) £0, the first assertion of the 
lemma is now obvious. Furthermore 


(H) = I o(Z) #0 
if H is a regular element of h. This proves that £0. 
Put Q = (q), Qa = Sa(q) (d0) and Q, =, (q). 


Lemma 2. For any Z€ 3’, Vz defines a bijective I of en) 
onto S(g). 


Conotnary 1. Fix pe S(g). Then for any Ze y,.there exist unique 
elements az(p) € S(3) and Be(p)€Q,@8(g) such that 


?P— %(p) =Tz(Bz(p)). 


Moreover! daz(p) Sap. 


COROLLARY 2. For any pc S(g) we can choose an integer r=0 such 
that the mappings Z—>€(Z)tar(p) and Z—>£(Z)'Bs(p) (Ze 3’) can be 
„extended to polynomial mappia of 3 into 8 (a) and D,@8 (3) a ai 


1 Pq denotes the degree of q. 
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The proof of all this is substantially the same as in [2(a),§7]. 


Remark. Assume 3 is abelian. Then it is a Cartan subalgeba of g and 
sò we denote it by 5 in this case. Since g=b-+gq, it is clear that 
© =G(q)G(h). Moreover it is clear from its definition (see [2(e),§7]) 
that 


on(Hyo)p— dup = 0 


for H,H,€6 and peS(h). Hence Ty(OG.(h) @S(h)) — {0} for HEH. 
Therefore since 
©, = S, (g) = DES, (9) + Di, 


we conclude that 


Ta(G.@S(h)) —Ta(O, @8(h)) (H €b). 


Lemma 3. Let r bean automorphism of g such that 37 =3. Then 3° ts 
invariant under r and 


agt (p7) == (az(p))”, Bat (p7) = (Bz(p))" 


for Z€ 3’ and peS(g). 

Since r is an automorphism of g which leaves 3 invariant, it is clear that 
£(Z7) =L(Z) (Z€ 3) and r maps q into itself. Hence 3’ is invariant under r. 
We can extend r uniquely to an automorphism of © and then to a bijective 
linear mapping of © 8(g) by setting (g@q)7—g7@q" (gE G, gE S(q)). 
Then it is obvious that 

(Tz(u))" = Txt (u7) 


for Xeg and uc G@S(g). From this the second statement of the lemma 
follows immediately. 


3. Some elementary facts about differential operators. Let Z be a 
vector space over C of finite dimension and U a nonempty open subset of E. 
Let §(U) denote the ring of all holomorphic functions on U. For any X € F, 
let @(X) denote, as usual, the derivation of (U) over C defined as follows. 
I£ FES(U), 0(X)f is the function 


Y —> {df (Y + tX)/dt} 1-0 (FET,LEC).. 


For any g€ §(U), we denote the endomorphism f > gf of §(U) again by g. 
Let D,(U) denote the algebra of all endomorphisms of §(U) over C generated 
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by 6(X) and g (ZEE,gEH(U)). We call (UV) the algebra of holo- 
morphic differential operators on U. For fe $(U), DED (UV) and XEU, 
we denote, as usual, by f(X; D) the value of Df and X. 

Now assume U is connected. Then (U) is an integral domain. Let 
MU) be the quotient field of (U). For any X € F, 8(X) can be extended 
uniquely to a derivation of M(U) over C. Moreover corresponding to any 
gEM(T), we have the endomorphism f— gf (FEM(T)) of M(T) over C, 
which we again denote by g. Let 2,,(U) be the algebra of all endomorphisms 
of M(U) generated by @(X) and g(XEE,gEeM(U)). Then D„(U) is 
called the algebra of meromorphic differential operators on U. Fix an element 
DED„(U). It is easy to see that if Df=0 for all f€ Q(U), then D—=0. 
From this it follows without difficulty that there exists an injective homo- 
morphism D —> Dn of D,(U) into D„(U) such that Daf = Df for DED,(U) 
and f€@(U). We may therefore identify 2,(U) with a subalgebra of 
Dm(U) under this homomorphism. In partieular, we have the algebras 
Di(E) C Dn (EF). 

Let E’ be the space dual to E. Then E’ and d(E) are both contained 
in D (E). We denote by D(H) the subalgebra of D (E) generated by 1 
and £’ + 6(H). D(E) is called the algebra of polynomial differential operators 
on E. The linear mapping X -> 3 (X) (X€ E) can be extended uniquely to 
a homomorphism @: S(E)>D(E). 

For any pe P(E) and ge S(E), let <p, qy denote the value of d(g)» 
at the origin so that <p, g> = p(0;3(q)). 


Lemma 4. The bilinear form (p,qg)—><p,g> on P(E)XS(E) is 
nondegenerate. 


Select a base (X;,---,4,) for E and let (à> - *, An) be the dual base 
for EB’. Then it is easy to verify that l 


LAAI + Aa, Xr.. X, == 0 
unless m; = m’ (1Sı=n) and 
LAI e Anma, Aam + XM m Mal e Mn. 
From this the assertion of the lemma is obvious. 
COROLLARY 1. The homomorphism 9: S(E)>D(E) is injective. 


This is an immediate consequence of the lemma. 
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COROLLARY 2. Fix X,€ E and let q be an element of S(E) such that 
p(Xo30(q)) =0 for all pe P(E). Then q=0. 


Define px,(X) = p(X. +X) for X€ H ad pe P(E). Then p— px, is 
an automorphism of P(E) and <pryqg>—p(430(q)) =0 (pe P(#)). 
Hence g=0 from Lemma 4. 

It is clear that 


(X) oA—A09(X) — A(X) (Xe B,v€ B’). 


‘Therefore it follows that D(H) is spanned by elements of the form p0(q) 
{pe P(E), q€ 8(E)). Fix DED(E) and Xoc E. Then it follows from 
Corollary 2 above, that there exists exactly one element Dx, € 0(S(E)) such that 
p(Xo;D) p(X; Dx,) for all pe P(E). As usual, we call Dx, the local 
wipe ession of D at Xo. i 


COROLLARY 3. Suppose D is an element in D(E) such that Des for 
every pE P(E). Then D=0. ` 


Fix X€ E. Then p(X ; Dz) == p(X; D) —0 for every p€ S(E). Hence 
Dxr=0. Now we can write D in the form D = 2 Pôu) where p;€ P(E), 
ISi: 


qE I(E) and q:,: - *, qr are linearly independent over C. Then 
— Dx= Zi pi(X)A(q) = 


and so it follows from Corollary 1 above that p(X) =0 (1StSr). This 
being true for every X € E, we conclude that ,—=0 (1511) and there- 
fore D—0. 


COROLLARY 4. Let y denote the linear mapping of P(E) 8 S(E) into 
D(H) such that y(p@q)—pi(q) (pe P(Z), qE8(E)). Then y is 
bijective. . 


It is clear from what we have seen above that y is surjective. On the other 
thand suppose Du Y(n qu) (meP(E), gE S(E)), where gu’ ',9 
‚are linearly independent over C. Then if D == 0, we have seen above (during 
‘the proof of Corollary 3) that p, = pı ==: —=9,—0. This proves that y 
.is injective. 

We know that F’ anid 6(#) are both contained in D(F). It follows from 
‘Corollary 4 of Lemma 4 that E’ N 0(#) = {0}. Let T(E) denote the tensor 
.algebra over E#’+ö(E) and ġa the homomorphisms of (F) into D(#) which 
corresponds to the inclusion mapping of E +-6(H) into D(H). Let U(E) 
bo the ideal in T(E) generated by elements of one of the following three types. 
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(1) ABK) — X) @a+a(X) - (AER, XB), 
(2) 6(X) @a(Y) —A(Y) @a(X) a (X,Y €E), 
(3) ADu—p 8A . (ap EF). 


Then clearly U (F) lies in the kernel of re 
LEMMA 5. U(E) is exactly the kernel of pa and therefore 
D(B) =TE)/U(R). 
Select a base (X1,- - -,X,) for E and the dual base (àr, © *, Àn) for F’. 


Define two injective linear anne a and 8 of Pe) and d($(E)) respec- 
tively into (E) as follows. 


a(1) = 1, a (A) — a (A01) ® Ai (1SiSnm21) 
a (AMAR + Agta) — a (As) Qa (Aae) D- = -Balrgt) 
B(1) = 1, B(8(X")) = 8 (0 (X) ) 88 (X) (1StSn,m21) 
BOME < Xam) ) BO) @B((X)) B- - -P OE)). 


Tt is sprite that ga(a(p)) — p, oz(B(@(q))) —i(q ) for pe P(E) and 
qE S(E). Now fix éE Z(E). It is clear from the definition of U(E) that 
we can choose elements € P(E), ge S(E) (411) such that qi,- © -,q 
are linearly independent over C and 


= Ea (p,) ®A(0(q)) mod U(E). 
Then l 
pa (é) = 2 pA (qu) 


and therefore if é lies in the kernel of ġa, we can conclude, from Corollary 4 
of Lemma 4, that p, =: : -= pp == 0. Hence £€ U(E) and this proves our 
assertion. , 

Now suppose Æ is the direct sum of two subspaces E, and E, Let m 
denote the projection of # on F; (¢==1,2) corresponding to this sum. Then 
a, can be extended uniquely to a homomorphism of S(#) onto S(E,). We 
call m; the projection of S(#) on S(E,). Note that S(E,) C S(#) (see 
[2(e),§6] and mp = p for pe S(Z,). 

Consider an element £E D(#,). Then 


t= D pd(u) 
StS 


“where pı€ P(B;), uE S(E,). Since P(E,) C P(E), 8(E,) C 8(#) [2(e), 
-$ 6], the right side can also be interpreted as an element of D(#). We claim 
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that in this way, we get an isomorphism of D(E,) into D(E). Let n, = dim F, 
and assume that the above base (X1,---,X,) of E is so chosen that 
(X, c, Xm) is a base for E, while the remaining elements form a’ base 
for F}. Define T(E) and U(E,) corresponding to Æ, as above. Then since 
E’ + 0(#,) is a subspace of E’-+-9(E), we can identify €(H,) with the sub- 
algebra of T(E) generated by 1 and #,’--9(E,). In order to prove our 
contention, it would be enough to verify that 11(#,) = Z(E.) NU(#). It is 
obvious that U(E) DU(E,). So now fix an element $€ Z(E) NU(EF). 
Then we can choose p, € P(#,), uE S(#,) (1SiS1r) such that qt © °, 
are linearly independent over C and 


¿=Z a (pı) ©B(A(q)) mod U(B,). 


Then l 
0 = r (É) = 2 pô (q) 


and therefore pı =` + `= pr== 0 as before. This proves that £€ U(E). 

Thus D(E;) can be identified with the subalgebra of D(E) generated by 
(1,8/-+9(E,)) under the homomorphism which preserves every element 
of EP +6(#,) (t—1,2). 

Since 6(Xi)A;=—=8y, it is obvious that any element of D(E,) commutes 
with every element of D®(#,). Hence we can define a homomorphism y of 
D(#,) @D(#,) into D(E) such that y(D,®D,)=D,D, (Dic D(F), 
i==1,2). We shall now prove that y is bijective. Since 


B+ 0(B) = F (B+ 0(E,)), 


it is obvious that y is surjective. Let B be the ideal in Z(E) generated’ by 
elements of the form aOb —b 8a (ae T(E,), bET(E,)). Since ġa (Z(FE:)) 
‘m= D(F) (t—1,2), it follows from Lemma 5 that BC U(E). Consider the 
subspace Zas =T (E1) OT(E,) of T(E). Then it is obvious that 


T(E) = T + B. 
We claim that 
u(E) N Ti = U, 


where U =T (E1) SU (E2) +U(E,) BT(E,). It is clear that 11,, is con- 
tained in the left side. Now fix £€ Taa Then, in view of what we have seen 
above, we can choose py€ P(E,), YES(E,), pa € P(E), wWEsS(H,) 
(StSr1SjSs41Skst) such that (qn: ` ‘,g:) and (5 ® “> Qa’) 
are separately linearly independent over € and 
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E= 2 e (Pu) D(a (g)) D alpa) DLO(g)) mod Uns. 


Therefore 
o psl) = È puð (q) ° plg) = E pypa’d (qqr) 
‘ ijk ijk 


since py,’ and d(g;) commute. But the homomorphism of S(E,) ® 8(#;) into 
S(E) which maps ¢@q onto qq’ (q€ S(E,), g € 8(E:)) is obviously bi- 
jective. Hence qg (1Sj=Ss,1=Z%kSt) are linearly independent in S (E). 
Therefore if ¢a (£) = 0, it follows that 


& pupu — 0 
‚for every j, k. But this implies that 
| D py pw — 0 
in P(E,)®P(E,) (see [2(e),§6]. Therefore 
= a (py) QbdQalpr) Dc =0 


for any b,c€ Z(E). Therefore == 0 mod U., and this proves our assertion. 
Now suppose DED(E,) ®D(E,) and y(D)—0. We have to show that 
D=0. Choose KED(E,) meD(E:) (1SiSr) such that D = Bi @ ne 
Select mE ©(H,), be T(B,) such that ds(a) =é sb) =y (1SiSr). 
Then 
y= u8 br € Ras n 


and 


u(r) =Z ém=y D) =0. 


Therefore v € Uiz. Put ds = ġe, 8 $s, Then die is a homomorphism of Ur 
onto D(#,) @D(#,) and it is obvious that U,, is contained in the kernel of 
diz. Hence 

D= BEO m= hl) = 0), 


Let U D V be two open, nonempty and connected subsets of #. It is 
easy to see that there exists an injective. homomorphism D— Dy of Du(U) 
into Da(V) such that gy is the restriction of g on V (geM(U)) and 
.(8(X))v is just the derivation 9(X) of M(V) (XE H). We may therefore 
identify D„ (U) with a subalgebra of D,,(V) under this homomorphism. Then 
„it is obvious that Dx(U) C Da(V). Hence, in particular, D(#) C D (E) 
CDU). er i : i ; 


i 
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Fix an element De D,(U) and a point K,EU. Then meee (lg) 
si 
where KES(U) and uE S(E). Put q= fi(Xo)qu Then it is obvious that 
$ 


f(Xo;D) =f(X034(q)) for every fE Y(U). Taking into account Corollary 
2 of Lemma 4, we obtain the following result. There exists a unique element 
Dy,€ @(8S(H)) such that f(X; D) —f(Xo;Dx,) for al fe G(U). Dx, is 
called the local expressions of D at Xo. 

Now fix De D„(U) and Yoc U. We say that D is defined at Xo, if we 
can choose an open connected neighborhood V of X, in U such that De Da(V). 
If this is so, we again denote by Dx, the local expression of Dat Xo. (The 
value of Dx, is independent of the choice of V.) 

Let Q(E) denote the quotient field of P(E). Then Q(E) CM(#). 
Let ©,(#) be the subalgebra of D„(E) generated by Q(#) and D(E). We 
call D(F) the algebra of rational differential operators on Æ. 


Lemma 6. Let D be an element in D,(E) and X, a point in E. Suppose 
D is defined at Xo. Then we can choose pE P(E) such that p(X.) 0 and 
pDED(H#H). Moreover 
| Dr = p(Xo)*(pD) x 

for any such p. 


Choose an open connected neighborhood U of X, in E such that De D,(U). 
Since 9,(#) = Q(£)D(#), we can choose pp€ P(E) (po540) such that 
poDE D(H). Therefore we can select q€ S(E), fie Q(U) and pe P(E) 
(1iSsr) such that qı,’ - -,q, are linearly independent over C and 


PoD—=_X Pl); 
isSisr 
D= & ol), 
1S4I<Sr 
where the second equation is meant to hold in D,(U). Then it is clear that 
(PoD) x= ER DE) = Z p(X) (g) (XE U). 


Therefore u = pofi (1Sı=Sr) on U. This implies that X, does not lie on 
the polar divisor of any one of the rational functions p/p, (ISi=r). Let 
q denote the h.c.f. of (Po p1,'° *,pr) in P(E) aid put p= p/q. Then 
pE P(#) and it is clear that pDED(E) and X, does not lie in the divisor of 
zeros of p. Therefore p(X,) 340. The second statement of the lemma is 
obvious. 

The group GL(E) operates on E. If f€ S6(#) andze GL(F) we denote 
by f° the function X>f(z!X) (XEE). Then f— fe is an automorphism 
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of $(E) which can be extended uniquely to an automorphism of M(E) over 
C. For any De D„(E), define De by 

Deg = (Dg*"*)* (g€ M(#)). 


Then D— De is an automorphism of Dm(F) which leaves P(E) and Q(E) 
invariant. Also (0(X))?—=@(2X) (XEE). Hence v leaves RO) D(E) 
and ©,(#) invariant. 


LEMMA 7. Let DED,(E),zE GL(E) and X€ H. Suppose D ts defined 
at X. Then De is defined at zX and (De).x = (Dx)’. 


Choose pE P(E) such that p(X)0 and £=pDED(E). Then 
De=qré and therefore De = (pr). Now pD =< €E D(F) and p*(rX) 
== p(X) 540. Hence D? is defined at zX. Moreover 


(Dr) (p?(X))**(&) ox = p(X) *(&) ax. 
Now fix q€ P(E). Then éq = (&g*")* and (éx)*q¢=—= (éxg*")*. Hence 
ET,  q(F; (x)=) oF sex) 
for Y€ E. Putting Y == 2X, we get 
q(aX ; (6) ex) =g (X 5E) =g (2X ; (Ex)*). 


This being true for every ge P(E), we conclude from Corollary 2 of Lemma 
4 that (&).x— (éx)*. Hence 


(Dr) = (p(X) ex)? = (Dx)*. 
CoROLLARY. Let U be a subset of E with the following two properties. 
1) If pe P(#) and p vanishes identically on U then p—=0. 
2) D 4s defined at every point of U U eV. 
Then if Dax = (Dx)? for X € U, we can conclude that D = D*. 


It follows from the above lemma that both D and De are defined at 
every point Y € U and (D—D*)y=0. Choose pe P(E) (p 340) such that 
A=p(D—D*)€Q(#£). Then if ge P(E), 


q(¥ 34) = q(¥;Ay) —0 


for Y€ U. Hence it follows from condition 1) that Ag=0. But then we 


can conclude from Corollary 3 of Lemma 4 that A=0 and therefore 
D— D? =Q. 
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Lemma 8. Fis an element {0 in Q(E). Then there exists a unique 
automorphism ur of D(H) such that p.(q) =q for qE Q(E) and 


KL) == G(X) + RER) (XeEE). 
Moreover (u,(D))* = pya(D*) (TE GL(E),DED,(E)) and 
Piste = Hts (GE QO(#), & 40,4 1,2). 


Let U be a non-empty open convex set in # such that U does not meet 
the divisor of £. Fix a point X,€ U and define 


x 
loge(X) e+ f tat (XU) 


where the integral is taken along the straight line-segment from X, to X and 
c is a constant such that £(X)) = e°. Put 


n = exp ( (1/2)log £). 


Then 7 is a holomorphic function on U and ¿== on U. Let vy denote the 
automorphism of D„(U) given by 


my(D) =D on (DE Da(U)). 


It is clear that 
mn(0(X)) =X) on 


— G(X) +" (0(X)n) 
=ô (X) + (1/2)£*(0(X) 6) 


for X€ E. Moreover vn(q) =q for q€ Q(E). Hence m obviously defines an 
automorphism of D,(E). Since the uniqueness of u; is clear, this proves the 
first statement of the lemma. 

Let a1, az be two automorphisms of D,(E). If a,(0(X)) —a(6(X)) 
(X€ #) and a, (q) = a3(g) (gEQ(E)), then it is obvious that a, == a}. The 
remaining statements of the lemma follow immediately from this fact. 


_ Remark. We shall usually write [4D o ¢ instead of p,.(D) (Dé ®,(#)). 
It is clear from the above proof that if D, ¢ and £+ are all defined at a point 
X,€ E, then D o ¢ is also defined at Xp. 


4. The main theorem on invariant differential operators. Let g be a 
reductive Lie algebra over C and @ its connected adjoint group. Then 
G CGL(g). Let %(g) be the subalgebra of those elements DE D,(g) for 
which D? == D (ge G). i 
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Leama 9. For any X € g, let (X) denote the element of D(g) gwen by 
(r(X))z = ([¥,X]) (Fe). 
Then tf DE D,(g), the following two conditions on D are equivalent. 


1) DEX,(g). 
2) r(X)oD—Dor(X)—0 for allXeg. 


Fix pe P(g) (p0) such that é==pD lies in D(g). Let U, be a 
non-empty open set in g such that p is nowhere zero on Uy. Fix EU, 
and choose open connected neighborhoods U and V of Y, and 1 in U, and 
G respectively such that VV and zY €U, for zeV and YEU. Then 
if ge P(g), the functions (,PJ> (Dg) (XY) and (z, Y) > (Dg)? (Y) are 
both holomorphic on V X U. 

Now suppose D € %(g). Fix q¢ P(g) and X€g. Then 


(Da) »'X (F) = (Dgs?'*) (F) (YEU) 


if ¢ is sufficiently near zero in C. From this it follows that Dıq=0 on U. 
Here D, ==7(X)0D—Dor(X). But D, € D, (g) and therefore Dq E Q (g). 
Hence Diq —0. But then we can conclude from Corollary 3 of Lemma 4 
that D, = 0. 

Conversely suppose 2) holds. Then the proof of Lemma 15 of [2(e)] is 
applicable and we conclude that 


Dex = (Dx)* (ze V,XEU). 


But then D = D=» (ze V) from the corollary of Lemma 7. Since G is con- 
nected, V generates G and therefore it follows that D € %,(q). 

Now we shall use the notation of §2 (with k=C). In particular 3 and 
£ have the same meaning as before. Let D be an element of D,(g) which 
is defined at some point of 3. Then we shall associate to it an element 
AED,(g) as follows. Choose q€ P(g) such that 1) q does not vanish 
identically on 3 and 2) D’ =qD isin D(g). This is possible from Lemma 6. 
For any 2€ 4, define pz€ S(g) by the condition (D’/)z—4(pz). Then it 
follows from Corollary 2 of Lemma 2, that there exists an element A’ € ,(3) 
which is defined everywhere on 3’ and 


(A)z—d(az(pz)) (Z€ 3’) 


We define A == g,1A’ where ga denotes the restriction of g on 3. It is easy to 
verify that A does not depend on the choice of g. It is also clear from Lemma 
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6.that A is defined at all points of 3’ at which D is defined. We shall denote 
A by 8g3 (D). 

Let 3(g) = D(g) NR). 


LEMMA 10, If DE ‘&(g), then da, (D) ts invariant under the normalizer 
of aim G. 


Let A==8,,,(D). Then A is defined everywhere on 3’. Fix sE G such 
that 2g==3. Then by Lemma 3, 23’— 9’. So, in view of the corollary of 
Lemma 7, it would be enough to prove that 


(Az)? = Aaz (ZE 9’). 


For X € g, define px € S(g) by the condition Dy=~6(px). Then pox = (px)” 
since DES(g) (Lemma 7). Hence 


Aer = Ô (asz (paz) ) = 9( (az (pr))*) 


-== (Ay)? (Ze) 
from Lemma 3. 


Let h be a Cartan subalgebra of 3 and Ņ the set of those elements in } 
which are regular ing. It is obvious that Y C 3’. Now fix De D(qg). Then 
A= 53,/3 (D) is defined everywhere on 3’ and it is easy to see that the element 
35/5 (A) of D,(h) is defined everywhere on J’. 


Lemma 11. 8g (D) = 8y (Sa (D)) for DED(g). 
Fix a point H €Y and let A= 8g (D) and O = sg (A). Choose 
pé S(g) such that Da =ô (p). Then Ag = 9 (an (p)). Now 
P— an(p) E€ Tu (Q88 (3)) 
from the definition of ay(p). Moreover if Og == ð(q) (q€ S(h)), we have 
i Balp) —9€ BG, @8(h)). 
On the other hand if we apply Lemma 2 to (3,5) instead of (6), we get 


8(3) =Tu(S(3) @8(5))- 
Therefore 


p—¢n(p) E€ Ta (Q.S (3) 8 8(Ņ)) CTu(G, @8(5)). 
This proves that 


p—q= (p—an(p)) + (an(p) —4) € Tr(6,8 8(5))- 
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Hence if we take into account the remark after Lemma 2, it becomes clear 
that (3% (D))a—=d(q) = Ox. This proves that ,% (D) = O. 

Fix a Cartan subalgebra h of g and let W denote the Weyl group of 
(8,5). Let %,-(6) denote the subalgebra of those elements of D, (Ņ) which are 
invariant under W. Put Sb) =9(b) N&,-(6), J(g) —=P(a) NJ(g) and 
J(b) = P(b) N3(h). Also let m= Ta where a runs over all roots of (g, b) 


which are positive (under some fixed order). Then r€ Ph). 
THEOREM 1.2 Put 


gn (D) mn (D) On! 


for DeS(g). Then 8,5(D)€3(b) and d, is a homomorphism of I(g) 
into $(h). Moreover an element D of X(g) lies in the kernel of this homo- 
morphism if and only tf Dp =O for allpeJ(g). 


We shall write § and & for 84,4 and 83,5’ respectively. It is obvious that 
3(D) lies in D,(h) and its definition is independent of the order of roots. 

Let c be the center and gı the derived algebra of g so that g= c€ -+ qu, 
where the sum is direct. Then c C h and h=c-+g,95. We can choose a 
compact real form gio of gı such that gi. is a Cartan subalgebra of g, 
(see, for example [3, p. 155]). Choose a real subspace co of c such that 
dimrto==dimec and t, spans c over C. Then go=—Co-+- Gio is a real form of 
g and Hoh M go is a Cartan subalgebra of go. Let Y be the set of all 
points H in 5 where r(H) +0. Then 8(D) is defined everywhere on J’. 
It is clear that if ge P(h) and g=0 on ho’ =b, 1b’; then g=0. Hence in 
order to prove that ô is a homomorphism of X (g) into D,(h), it is enough to 
verify that 
(8(D,D,) — 8(D;) 08(D,))z=0 


for Hehe and D,D,€S(g). This is proved in the same way as Lemma 7 
of [2(a)]. 

For a given se W, we can choose x in G such that Ad(z) =s on h. 
Then if De &%(g), it follows from Lemma 10 that 


(8 (D) )* DI =% (D). 


Moreover m’ =e(s)w where e(s)=1 or —1. Therefore it is clear that 
8(D) € X-(ŅH). Hence in order to prove that §(D) € X(Ņ), it would be enough 
to verify that §(D) € Dh). 


2 This theorem is a generalization of Theorem 1 of [2{e)]. ` 


6 
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We know (see §3) that D(g) =D(c)D(g.). Hence D == % Em where 


ists 
&€ Dc), m€D(gi) and &,- > +, are linearly independent over €. Then 
since D € %(g), it is obvious that mE 3(g.i). Moreover 3(€) —=£ for £€ a: 
Hence it follows from what we have proved above, that 


&(D) 25m). 


So it would be sufficient to prove that 8(m:) ED(hı) where, =HNg.. Thus 
in order to complete the proof of the first part of Theorem 1 we can confine 
ourselves to the case when g is semisimple. This will be done in §6. 

We now come to the second assertion of the theorem. Fix péJ(q) 
and DEX(g). Then it follows from the defintion of (D) that p(H;D) 
= p(H;8(D)) for HEY (see [?(a), Lemma 6]). Therefore if $(D) —=0, 
it is obvious that Dp=0 on. Let n==dimg. Then it is easy to verify 
that the holomorphic mapping (x, H) —>xH is of rank n on & XY. There- 
fore (b’)@ is open in g and hence Dp==0. Conversely suppose d(D) £0. 
It follows from Corollary 2 of Lemma 2 that we can choose an integer m = 0 
such that Y = r™7 (D) € X(Ņ). It is obvious that Y 40 and so we can 
select a point Ho E ho’ such that Vr>£0. Since gio is a compact real form of 
G1, po is stable under W. Moreover since H, is regular in g, SH, He for 
8541 in W. Fix an open neighborhood U of H, in 5,’ such that sU N U =Ø 
for s41 in W. Then we can choose f€ Co” (U) such that fi(Ho; V) 
=f (Ho; Vm) £0. Put f(H) = 2, h(sH) (HE). Then f is invariant 


under W and f(H,; Y) =f:(Ho; V) 0. On the other hand we can select 
gi € P(§) such that 


| f(sHo; V) —u (8H; V)| = (1/2) | FH; V)| . 
for s€ W. Put 
g= [W] È qt 
sew 
where [W] denotes the order of W. Since f and Y are both invariant under 
W, it is clear that 
f(Ho; V) —4(Hos V) = [WI E FH; V) (sd; V)} 
and therefore 
| f(m; V)—g(H,;Vv)|s (1/2)| FH; V)|- 


This shows that ¢(H,;V) +0. But ge J(h) and therefore by Chevalley’s 
Theorem (see [2(a), Lemma 9]), there exists an element pe J(g) whose 
restriction on h is q. Therefore 
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P(Ho;D) —q(Ho;¥(D)) =7(Ho)*"q(Ho; V) 40 
and this proves that Dp=£ 0. 


5. A simple lemma. Let E be a vector space over € of finite dimension. 
Assume that we are given a nondegenerate symmetric bilinear form B on E. 
We identify E with its dual under B. Let (—1)4 denote a fixed square-root 
of —1. 


Lemma 12. There extsis a unique automorphism D>D of D(E) 
such that 
Lun — (HZ), (O(Z)P——(— a (KEE). 


Similarly there exists a unique anti-automorphism D—> D* of D(H) such that 
AX*—X, 9(X)*——A(X) (XE #). 
Let x be an element of GL(E) which leaves B invariant. Then 


(D?)*==(D*)#, (De) (Ñ)? 
for DED(E). 


We use the notation of 83. Since E = F’, (H+ 4(#), 1) generates 
D(E) and therefore the uniqueness of both * and ^ is obvious. We shall now 
verify their existence. 2(H) is now the tensor algebra over E-Hö(E). 
Define two linear mappings * and ° of #+ 4(#) onto itself according to the 
statement of the lemma. Then obviously ^ and * can be extended uniquely 
to an automorphism and an anti-automorphism respectively of Z(H). It is 
easy to verify that the set of generators of U(E) (described in § 3) is mapped 
onto itself by each of these operations. Therefore we get the corresponding 
operations in D(E)—=X(E)/U(E). The last assertion of the lemma follows 
from the obvious fact that if two automorphisms (or anti-automorphisms) of 
D(E) coincide on H+ 6(#), then they must be identical. 


6. Completion of the proof of Theorem 1. Let g be a semisimple Lie 
algebra over C and ha Cartan subalgebra of g. Put B(X, Y) —tr(adX ad VY) 
(X,Y €g) and let By denote the restrictions of B on 5. Then both B and 
By are symmetric and non-degenerate and so we can identify g and h with 
their dual spaces respectively under these bilinear forms. Put 88,4 (in 
the notation of Theorem 1) and define r(X) (X€ gq) as in Lemma 9. 


Lemma 13. Let D be an element of $(g). Then D and D* are also 
in 3(g). Moreover &(D) €(h) and 
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3(D)-(8(D)),  3(D*)—8(D)*. 
Finally (+(¥))=1(Y) and (1(¥))*=—71(¥) for Yeg. 
We can choose, as before, a compact real form go of g such that bo ==) N go 
is a Cartan subalgebra of ge. Let G, be the real analytic subgroup of @ corres- 


ponding to go. Then G is compact. Define the space € (g) as in [2(a), 
§§ 2 and 5], and for any fE 6 (go), put 


HE) =r (E) f, fll) de (H € ho) 


where the Haar measure dz on @, is so normalized as to make the total 
measure of @, equal to 1. Then we know [2(a), Theorem 3] that #,€ € (Ho). 
As before, let họ’ be the set of all regular elements in Ho. Then if DE D(q), 
we know from §4 that ö(D) = rêg (D) om" is defined everywhere on by’ 
and it follows from the proof of Lemma 15 of [2(a)] that 


por =8(D) dy 


on hy’. Let dX and dH denote Euclidean measures on go and h, respectively. 
We normalize them in such a way that 


| J. H(X)ax— f | x(H)|e aH Se ma 
for fE Colgo) (see [2(a), p. 105]). Now for fe 6(g.) and gE &(ho), 
define their Fourier transforms f and ĝ by 


HR) = ff (Z)ezp( (—1)B (X, ¥)) aX (F € go) 
and 


§(H’) = f9(H)exp((—1)4B(H, H’) )dH (H’€ Bo) 
Then there exists [2(a), Theorem 8] a number 640 such that 
l p= elh) 
for all fE B (go). 


We know [2 (a), Lemma 1] that (Df)* =D} for DE D(g) and fE (go). 
Similarly D* is the adjoint of D and corresponding statements hold for 
elements of (bh). 


Since B is invariant under G, it follows immediately that 
(Y = (f) 
for y€ Go and fE (go). Moreover it follows from Lemma 12 that the 
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operations of G on D(g) commute with both ^ and *. Hence ${g) is mapped 
into itself by ^ and *. . 
Fix Y € go and put „=exptY (GER). Then 


F(X3r(¥)) (dv (X) /dt} = {df (yX) /dt} 1-0” (X € go) 
Hence if f€ 0.” (qo), it is obvious that (+(¥)f)" is the function . 
X> {df (yX )/dt} =f (X37(Y)). 


This proves that (r(F))/=r(Y)f. Since 0.” (go) is dense in 6 (go), this 
shows that (r(Y))°==7r(Y) for Y €g, and therefore also for Y€g. More- 
over we know from Lemma 6 of [2(e)] that +(X)*——7(X) (Xeg). 

Now fix D€ 3(g) and first let us assume that $(D)ED(h). Then we 
have seen in §4 that 8(D) €%(). But (Df)°==D} and therefore 


Bor din = colpo) = 0(8(D) $y)” 
= 6(8(D))* ($y 
for f€ @(go). Also 7 a 
poi — S (D) dr 08(D) (H) 


on ho’. Let @w(Ho) denote the set of all functions on @(.) which are 
invariant under W. Then it follows from [2(a), Theorem 4] and the above 
result that l 


(DY (rg) = 8 (D) (xg) 


on bo’ for every g € Bw(ho). Fix an element H, € ho’ and an open neighbor- 
hood U of H, in hy such that sU N U =Ø for s41 in W. For any 
BEC.” (U), put l i 
ge =r >, (8) 8°. 
` sew 


Then gg E Co” (Ho’) and it is invariant under W. Let é be an element of X,(h) 
which is defined everywhere on ho‘. Then it is clear that £8* == (£8)! =— 0 
on U if s541. Hence if we take g == gp, in our result above, we get 


3(D)B—=5(D)ß 


on U. This proves that (8(D) —8(Î))m,—0. But since è(D) —8(D) lies 
in D, (h) and hy’ is open in Bo, it follows that 8(D)° =~ 8(D). 

Now let D be an arbitrary element of (g). Since =? is invariant under 

W, by Chevalley’s Theorem [2(a), Lemma 9] there exists an element „€ J (g) 

` such that (H) —=r(H)?* (HC bh). Moreover in view of Corollary 2 of Lemma 
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2, we can choose an integer m 20 such that 8(D) on™ lies in D(H). Put 
D,==Doy™ Then 


8(D1) = 8(D) o8(n®) —3(D) ont" € D(H) 


and therefore 3(D,) —5(D,)° by the proof above. Let g be the degree of m. 
Then y is homogeneous of degree 2g. Therefore it is obvious from Lemma 12 
that 7 <= (—1)%(n) in D(g). Hence D, = (—1)9"D04(y)™ and therefore 


8(D,) = (—1)9"8(D) © 8(8(y")) 
— (—1)3(D) o8 (77m) 


from [2(a), Theorem 1]. Now suppose 
| (D) — > g(r) 
1<i<r 


where ge Q(h), meS(h) and ps,:- +, pr are linearly independent over C. 
Then 
= gô (pin?) = (—1)0"8(Di)" € DB), 


and we conclude easily from Corollary 4 of Lemma 4 that gePf(h). 
Hence 8(D) € D(H). But D was an arbitrary elements of X(g) and D> D 
is an automorphism of Y(g). Therefore $(D)EX(h) for every Dé S(q) 
and it follows from our earlier proof that s(D) —=3(D)“. 

It remains to show that 8(D*) —8(D)* for DE S(g). Fix H, and U 
and for any BE Ü,*(U) define gg as above. Let £«,(g.) be the set of all 
functions in @(go) which are invariant under G,. Then by Theorem 4 of 
[2(a)] there exists a unique element fg€ 6a,(go) such that fe= gg on bo 
Then $n — rgs = È (8) B*. But if Fa F€ 6e,(Go), it is clear that 
SFR,dX— S|r(H)| F,(H)F.(H) dH 

— (1) f ripr, dH 


where g is the degree of m. Hence if «, 8€ Co” (U), 
| S Die fe aX = (—1)*(W] fen, B 4H 


since (dpr)? = €(8) pny, (SE W). But dp. 3(D) gy, and =a on U. 
Hence 
- f Dfa* fp dX = (—1)9[W] [8(D)a- pd. 





On the other hand D* is also in (g) and therefore 
| SDfe fa dX = ffa: D*fa dX = (—1)*[W] fa: 8(D*)8 dH. 


i 
I 
| 
i 
t 
| 
| 
ic 
| 
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This proves that (§(D)*—8(D*))y—0 for all HEU. But since U is 
open in ho, this implies that $8(D)*—8{D*). The proof of Lemma 13 and 
therefore also of Theorem 1, is now quite complete. 


7. Application to invariant distributions. We now return to the 
notation of §2 and take k==R. Let G be a connected Lie group with Lie 
algebra g. Fix a point Z,€ 3’ and an open neighborhood Q of Z, in g. 


Lemma 14. Let f be a locally invariant O” function on Q. Then? 
f(Zo; D) =f (Zo; 854 (D)) 
for DE D(g.). 
This is proved in the same way as Lemma 10 of [2(e)]. 


Lemara 15. Let w denote the mapping (z,Z) >aZ of GX4 into g. 
Then rank dr—=n everywhere on GX 3’. Here n—dimg. 


Since £(Z) 50, it is clear that [Z, q] =q for Ze 3’. Our assertion can 
now be proved in the same way as Lemma 12 of [2(e)]. 


Let dx denote the Haar measure on G and dX and dZ the Euclidean 
measures on g and g respectively. 


Lemma 16. Put Q=2(G X3) = Gy’. Then O is open in g and for 
every ae Co” (EX 3’), there extsts a unique element fa € C° (Q) such that 
f P(a2Z)a(2:Z) dz dZ = J, F(X)fa(X)aX 
/ axa’ a 
for every FEC. (Q). The mapping a— fa of C° (GX 3) into 0,” (Q) is 
continuous and surjective and Supp fa C (Suppe). 
The proof of this is similar to that of Lemma 13 of [2 (e)]. 
COROLLARY 1. Let F be a locally summable function on Q. Then the 
function (2,2) > F (zZ) is locally summable on GX 3’ and 
f F(aZ)a(2:Z)de dZ = f F(X)fa(X)aX = 
/ axe’ 2 
for every a€ O” (GX 4’). 
This follows from Corollary 2 of Theorem 1 of [2(e)]. 


8 ge denotes the complexification of g. Similarly in other cases. For convenience 
we write 8g’ instead of 85, a,- 
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| "'Lerana 17. Let Gy and 3, be open subsets of G and 3’ respectively. We 
assume that G, is connected and not empty. Let T be a locally invariant 
distribution on Q, = Goo. Then there exists a unique distribution op On 3o 
such that 

ie T (fa) = or (pa) (a€ Co” (Gy X do) 
where _ Ba(Z) = fa(z:Z)dz (ZE %)- 


Moreover or is locally invariant (with respect to 3) and op=—0 implies that 
T = 0. 


Everything except the local invariance of or is proved in the same way 
as Theorem 2 of [2(e)]. Now fix 8E C.” (3o) and Y€ 3. We have to prove 
that op(r(Y)B) 0. Select yE Ce” (Ga) such that fy(z)de—1 and put 
a==yX B and a—yX7(¥)fs. Then if F€ 0.” (Ro), we have 


Sfx(X) F(X) AX = fy(a)B(Z;r(F))F(zZ)dad2. 
But it is clear that 
| [B(Z;r(X))F (a2) dd = fp(Z)F (a; ¥:Z)dedZ 
ikele F(a:Z) =F(zZ) (ze Qo Z E 36). Therefore 
l S fol dX =— fy(z;Y)8(Z)E(2:Z)drdZ = — f fal dX 
hele a= Yy X 8. This proves that fe, —— fo, and therefore 


| r(r(F)RB) =T (fa) = —T (for) =— or (Ba). 
But since 

7 Sr; P)dr—0, 
| 
it is|clear that Ba,—0 and therefore or(7(Y) 8) == 0. 
COROLLARY 1. Assume that Q, == G and T ts invariant under G. Let 
Z be the subgroup of all EEG such that 3o ==3o Then or is invariant 
under E. 


Let =, be the normalizer of 3 in G and Z, the analytic subgroup of G 
corresponding to 3. Then 5, is the connected component of 1 in &, and if 
Ze is the center of G, 3,/ZeE, is finite (see [2(b), Lemma 15]). Since 3 
is reductive, the measure dZ is invariant under &, and therefore also under 
Hı. [Now we may obviously assume that 3, is not empty. Since it is open in 4, 
it spans 3 over R. Hence € C 5, and this proves that dZ is invariant under 8. 
Now fix y as above and for given BE C.” (30) and £€ E, define B,(Z) 
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(2) (Z€ ao). Then or(ßı) =T(fa,) where a =y X Ay. On the other 
hand ` 
SF dX — fy(z)B(EZ)F (zZ) dedZ 
— (y(zE)B(Z)F(z2)dedZ 


for any FEC," (0,). Put a(2:Z) =ylz£)B(Z) (ze G,ZE gj). Then the 
above equation implies that fa, — fa and therefore 


or(Bi) =T (fa) = T (fa) =or(ß), 


since 
falz:Z)dr=ß(Z) (Z € o). 
This proves the corollary. 


COROLLARY 2.4 For any DEX(go), write A(D) =ñ (D). Then 
opr = A(D)or under the conditions of Lemma 17. 


Put T == DT. Then T” is also locally invariant and T” (fa) =T (D*fa) 
‚for a€ C” (Go X ao). Fix FEC,” (Q,) and put Fi =DF. Then 


Sfe(X; D*)F(X)4X = f faF, dX 
== fa(s:Z)F,(zZ)dzdZ. 
As usual, define F(2:2)=F(zZ) (z€ Go, Z,€ §o). Then since D E (ge), 


it is clear that 
F (22) == F (£Z; D) = F (zZ; D’). 


Moreover from Corollary 2 of Lemma 2, we can choose g; € ©, (qo), ME S (Go) 
and a@€ O° (3o) (1&1 r) such that 


Dz = (A(D))z + EZ) (Teg 8 f)) 
for Z € 4. Since 
(D*) «z= (Dr)? 
it follows that 
F(e2;D*) om P(e: 25 A(D)) + EF (e5 9633 5) 


‘for ze G, and ZE 4. Hore & is the differential operator ad(p,) on 3o. Put 


(2:2) = a(£:2;A(D)*) and (2:2) —a(e3g*:Z2;4*) (1StSr), 
"where the star denotes the adjoint, as usual. Then 


fD*fa FAX = Z fai(w:Z)F (0) dedZ 


t This can be regarded as a generalization of Lemma 14 to distributions. 
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= > (fof dX. 
osisSr 
This proves that 
D*fa = > fa, 
osisr 
and therefore 
T (fa) = Z re): 


Sr 


But since € ©, (qo) (1StS1r), it is clear that gih — 0 where h is the con- 
stant function 1 on G. Hence 


fof de= ff: gh de =0 
for any fE C.” (Œ). This shows that fa, = 0 for i= 1 and therefore 
T (fa) = or (Ba) = or (A (D) *Ba). 


Since the mapping a — Ba of Co” (Go X go) into Co” (30) is obviously surjective, 
this proves that or: =A(D)or. 


COROLLARY 8. Let D,,D.€3(go). Then 
A(D,D,)o7 = A(D,)A(Ds3) or 
in the notation of Corollary 2 above. 
This follows from the fact that (D,D,)T=D,(D;T). 


8. An explicit formula. Let pp, (p€8(g.) denote the natural 
projection of S (go) onto S(3.) with respect to the decomposition go == 30 + qo 
(see 83). Define Le P (3) as in §2 and put” 


EAD 0 tè mm pe (D) (DED(3) 
in the notation of Lemma 8. 


Let I (go) be the algebra of all invariants of G in S(g.). We keep to the 
notation of § 7. 


THEOREM 2. Let T be a locally invariant distribution on OQ). Then 


A(5(p) Jor = (ip) ©) ox 
for pe I (ge). 


Let c be the center and g, the derived algebra of g. We can obviously 
chooge a real, symmetric and nondegenerate bilinear form B on g such that 


* Actually it is not difficult to show that there exists an invariant polynomial 
function n on g such that 77 = f. : 
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1) B(X,Y) —tr(adXad F) for X,Y €g, and 2) B(X,Y)=0 for XEc 
and Yég, Then B is invariant under G. Extend this form on ge by 
linearity over C and identify g, with its dual under B. Then S(g,) =P (qe) 
and it follows from Lemma 1 that B, the restriction of B on ĝe, is also non- 
degenerate. We identify 3. with its dual under B,. Then it is easy to verify 
that p, is simply the restriction of the polynomial function p on ĝe (p € S (ga) )- 

Let w denote the polynomial function Y->B(X,X) on ge We shall 
first prove the following result. 


Lemma 18. A(@(w) = £40(o,) 0 &. 
Fix a Cartan subalgebra h of 3 and let h’ be the set of all elements of 5 
which are regular in g. Put 


D—=A(8(w)) —£40(o,) o&. 


Let Z be the analytic subgroup of @ corresponding to 3. It follows from 
Lemma 10 that D is invariant under &. Moreover ao’== |) éh’ is an open 
fez 


and non-empty subset of 3° (Lemma 15). Therefore since DED, (3o), it 
would be sufficient to verify that Dep —0 for ¢€B and Heh’. But Dey 
= (Dyz)* because D is invariant under =. Hence we have only to prove that 
Dy==0 for Hey. 

Let P be the set of all positive roots of (g.,5.) (under some fixed order). 
For any root « define X. as in the proof of Lemma 1. We normalize Yo and 
Xa in such a way that B(Xe,X«) <1. The restriction By of B on ġe is 
also nondegenerate. We identify 5. with it dual under By. 

Define subsets P, and Py of P as follows. A root a€ P belongs to P, or 
P, according as Xa lies in ĝo or qo. Then (see [2(a), p. 98]) 

o=o +H? D Xefa, 


aePq 
w= oH? D Laka, 
Qe Pa 


where wp is the restriction of w on þe A simple computation shows that 
Ty (À (Xaa) 81) =—a(H)*X X24 a(H)Hea (aeP,Heh) 


where A is the canonical mapping of S(g,)} onto ©. Here Hy is the element 
in þe which corresponds to « under Bs. Therefore 


o=o? X a(H)*Ha—2 D a(H) Ta (XaX-a) 81) 
a E€ Pa ac Pq 


for H€ H. This implies that 
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(A (8 (o) ) ) a = 3 (w) see ee) (HEY). 
We find in the same way that 
mot? X a(H) He —2 X a(H) Tu (AXXa) 81) 


(Hey). 
Now fix a point Ha € h’. Choose an open convex neighborhood U, of Hy 
in 3, such that 1) every point of U, is regular in ge and 2) there exists a 
holomorphic function y on U, such that ¿=n? on U, Put U =U, Nà. 
Then if ¢ is a C® function on U, it follows from Lemma 3 of [2 (a)] that 


(H; 8(a,)) =$(H ;0(op)) Fr oye AAAs) 
—2 2 a(H)*$(13A(Ze¥-2) : H) (HE UNS). 
ae Pa 


Now fix fe C” (U). It is enough to show that f(H);D) =0. Put g—nf. 
Then 
F(E; D) =f(H;A(i())) —1(H)*9(H38()) (HET NY). 
Put 
T == II a, ma = I] a and m= JI Q. 
aeP ae Pq ae Py 

It is obvious that ¢(H) = (—1)'q(H)* for HE },. (Here r is the number 
of roots in Pa.) Since the set Jo N Us is convex and therefore connected, it is 
clear that »(H) == erq(H) (H €% N Us) where eis a constant such that e == 1. 

Now g(1;A(XaX-a): H) =g(H;1(A(XaX-a))) for a€ P, (see Lemma 
11 of [2(e)]). Since £ and therefore also ņ are locally invariant (with 
respect to 3), it is clear that 


r(A (XaX-a))g =q (à (XaX-a) )f. 
Hence we conclude from our formula above that 
9 (H58 (oa) ) — ef (H; 8 (wp) © Ta) +2 2 (ETF; 0(Ha) © ma) 
| Re 3 (E) na (HE) A(XaXa) : H) 
for He UN}. On the other hand, it follows from our formula for (A(d(0)))z 


that 
f(H;A(G(@))) = F(Z; 8(a,)) +2 3 a(H)“f(H56(Ha)) 


DIFFERENTIAL OPERATORS AND DISTRIBUTIONS. 559 
=f (H;0(%)) +2 Z «(HI "FCH50CHe)) 
—2 X a(H) f (1; A(XaX-a): H) 
This proves that ki 
m(H)f(E;D)=—f(8;0) © (HEUNS) 
where O is the element of D (ġe) given by® 
D=O) 42,3 00 Ha)ra) — 2r D IH): 
We shall now verify that D—0 and this would prove the N, result. 


Let a1, 2," * ",% be all the distinct roots in Pg. Then ma = as" * -ar 
and {8(ap) a} == 28(a%) (see [2(a), p. 98]). Hence 


{8 (wp), 2g} = 2 I ay dl) O (an > + ar) 
ItSr 
== 2r 9 
| a Z atu) +g 
where g € 8(§.). Hence 
O=g H2 2 a*(0(Ha)ma) E Abe). 
aEP3 

Therefore applying the differential operator 1 to the constant function 1, 


we get , 
l O — J1 = â (wg) + 2 2, a° (0 (Ha)ra). 
aers 


On the other hand if fo denotes the constant function 1 on U, we have 
. m(H)fa (E; D) =~—f.(H;0)——O(H) (HeUN}). 
But it follows from our formula for (A(d(o)))z that 


fo(H; D) =—n(H)*y(H;8(,)). 
Therefore 


O (H) —9(H 3 8 (o)) (HEU ND). 
But since y is locally invariant (with respect to 3), we conclude from Lemma 
14 that 
n(H;8(0)) =n(H 58 (3)))- 


°If Do D; are two differential operators, we denote D,oD,—D,0D,, as usual, 
by {D,, Ds}. 
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But 845’ (8(w3)) = my3 (wp) Om, from [2(a), Lemma 8]. Hence 
O (H) = 9(H; rng don) om) = er (H) >r (H; â Co) ). 


However we know that d(ap)r—=0 [2(a), p. 101]. Therefore O = 0 and 
so the lemma is proved. i 

Now we come to the proof of Theorem 2. It is obviously enough to 
consider the case when p is homogeneous. Let A denote the derivation of 
3(g.) given by AD == (1/2) {ð (o), D} (DeS(g.)). Similarly let vo denote 
the derivation of D, (3e) defined by v= (1/2){A(d(w)),E} (€€ Dr (8o) ). 
Then it follows from Corollary 3 of Lemma 17 that 


A(AD)or = (wA(D))or (DE (ge) ) 


for a locally invariant distribution T on 9). Hence we conclude by induction 
on m, that 
A(A™D) og =a (vo"A(D) Jor (m= 0). 


Let p be a homogeneous element in /(g.) of degree k. It is clear from 
its definition that A(p) =p, Moreover Afp—k!d(p) (see [2(a), p. 99]). 
Therefore 


KIA (3 (p) or = (vo¥py) or. 


But A(@(w)) =, (8(o,)) from Lemma 18 and p; = ;(p,). Therefore since 
a; is an automorphism of D,(3.), it is clear that 


vp = pe(*p,) 
where » is the derivation of ®,(3.) given by 


vë = (1/2) {ô (w4), é} (EE D, (40) )- 


Moreover p, is also a homogeneous element of S(3,) of degree k and *p, 
=k! (p) [2(a), p. 99]. Therefore 


Be (ps) = blu; (8 (pa) ) 
and this proves that 


A (0 (p) )or == m (8(p4) ) or 


9. An elementary result. For £ € ge, define the derivation dx of S (go) 
as in [2(e), §7]. Then it is obvious that I(g.) consists of all p€ 8 (ge) 
such that drp==0 for every XEge Since [a,q] Ca, it follows that if 
péI(go) then dzpa=—=0 (Z€ 3.) and therefore p,€I(g.). Fix a Cartan 
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subalgebra h of 3 and let W(g) and W(3) denote the Weyl groups of (8o, be) 
and (3o ġo) respectively. Then W(3) is generated by the Weyl reflexions se 
corresponding to the roots a in P, (in the notation of the proof of Lemma 18). 
Hence we can regard W(3) as a subgroup of W(g). Let w(g/3) denote the 
index [W (g) : W(3)]. Ä 


Lemma 19. Let J denote the image of I(g.) in I(g.) under the 
mapping p— p, (p&I(g)). Then I(3.) is a free abelian module over J 


of rank w(g/3)- 


Let p be the subspace of 3 complementary to } such that [b,p] C p (see 
Lemma 1). Then we have the decompositions 3 = b + p and g=§+(p+q). 
Let E, and E, denote the corresponding projections of 8(3) and S(g-) 
respectively on S(h.) (see §3). Define p=E,p (pEI()), I~ Eag 
(gE I(30)), Ja = Eol (go), Ja = Esl (30). Then by Chevalley’s Theorem [2(a), 
Lemma 9], J, is the algebra of all invariants of W(3) in S(b.) and E, 
defines an isomorphism of I(3.) onto Jy. Similarly E, defines an isomor- 
phism of I(g.) onto J, which is, in fact, the algebra of all invariants of W (g) 
in &(§,). Since (p,)şg == py for pe I(g.), it is clear that under the above 
isomorphism of I(3.) onto Ja J is mapped onto Jy. Therefore it would be 
sufficient to show that J, is a free abelian module over J, of rank w(g/). 
The proof of this is substantially the same as that of Lemma 8 of [2(c)]. 


10. An example. As an application of the above theory, we shall con- 
clude this paper with a proof of the following theorem. 


THEOREM 3. Let g be a reductive Lie algebra over R und S the set of all 
singular elements of g. Let T be a distribution on an open subset Q of g. 
Assume that: 


1) T ts locally invariant; 


2) There exists an ideal U in I(g.) such that dimI(g)/U<» and 
d(u)T =0 for we Ul; 


3) Supp7 cans. 
Then T =Q. 


We use induction on dim g. Let us assume that contrary to our assertion, 
T20. Consider the space X of all distributions on Q of the form 3 (p) T = 0 
(pE I(g.)). Then it is obvious from condition 2) that dim ¥ <œ. It is 
also obvious that every distribution in X satisfies all the conditions of the 
theorem and 2 {0} since TEXT. 
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For any p in F (8o), let p(p) denote the linear transformation T” > 3 (p) T” 
(TEXT) in X. Then p is a representation of the abelian algebra I(g.) on 
the finite-dimensional space 2%54{0}. Hence we can choose an element 
T, 40 in X and a homomorphism x of I (go) into C such that 6(p)T, = x(p)To 
for every p€I(g.). We intend to derive a contradiction by proving that 
T= 0. 

Let us change notation and write T instead of Ty. Fix an element Z, € 0. 
We have to show that T—0 around Ze Let c be the center and q, the 
derived algebra of g so that g is the direct sum of c and gı. If g=c, it is 
clear that S is empty and therefore T’=0. Hence we may suppose that - 
Qi: {0}. First assume that dim g, < dimg. Choose open connected sets Co 
and Q, in c and g, respectively such that En +0, CQ. Then it would 
be enough (see [2(e), Lemma 3]) to show that T (a X 8) = 0 for a € C,” (to) 
and BE C.” (Q1). Since c C I(g), 0(C) T= x(C)T for Cec. Now fix g 
and put T'g(a«) =T (a X 8) for a€ C.” (co). Then Ts is a distribution on co. 
Let @i,:-- +,C, be a base for c over R. Then 6(C,7+0,?-++- --+0,*) is 
an elliptic differential operator on c. Since 


(0 +: +O?) Tp x (Cr + + 0,7) Tp, 


it follows that Tg is an analytic function on ty. Let dC denote the Euclidean 
measure over c. Then it follows from the differential equations 6(C)T, 
—x(C)T; (C€c),. that 


T'g(a) = v (8) fa(C) ex ac (a€ 0o” (co)) 
where »(8) is a complex number independent of a Choose a € C,” (to), 
such that 

$%0(C) XO dC —1. 
Then 
v(B) = Tp (%) =T (a X B) 


for 8 € C.” (Q1). Hence v is a distribution on 0,. It is obvious that r(X)v = 0 
for X €g, and 6(p)v— (p)v for p€I(gi.). Moreover if X€ g, and (Er, 
then X-+C is singular in g if and only if X is singular in g,. Hence 
Suppr C Qı N S, where Sı =g: N S. Since dimg, <dimg, our induction 
hypothesis is applicable to g, and therefore y==0. But then 


T (a X B) =v (8) fa (C) ex d0 = 0 


for æ € C.” (co) and BE 0.” (N,). This proves that T —0 around Ze. 
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So we can now assume that g, == g and therefore g is semisimple. Then 
Zo = H,-+X, where H, is a semisimple and X, a nilpotent element of g and 
[Ho, Xo] =0 (see [1, p. 79]). First assume H, 340. Let 3 be the centralizer 
of H, in g. Then since H, is contained in some Cartan subalgebra of g, 
it is clear that 3 is reductive in g and rankg—rankg. Define q as in Lemma 
1. Since Xo€a, adX, maps q into itself. Also the eigenvalues of ad Zo 
—ad(H,+X,) in q are the same as those of ad He. Hence none of them 
can be zero. Therefore £(Z,) 40 and so Z,€ g in the notation of §2. 

Choose open connected neighborhoods Go and ĝo of 1 and Z, in G and 3’ 
respectively such that Qo == Gogo C Q. We now use the notation of §§ 7-9. 
Then in view of Lemma 17, it would be enough to prove that or—=0. Fix 
BEC,” (30) and assume that every element of Supp is regular in 3. Choose 
yE Co” (Ga) such that fyde—1 and put ay Xf. Then or(8) =T (fa). 
Let X € Supp fe. Then by Lemma 16, X — zZ for some ze G, and Z € Supp £. 
Therefore Z is regular in 3 and £(Z) 540. This obviously means that Z, and 
hence also X, is regular in g. Therefore Supp fe does not meet J and hence 
T (fa) —=0. This proves that every point of Suppor is singular in 3. Since 
¢ takes only real and non-zero values on ĝo, it is clear | £ |?—=€? on 3. and 
| ¢ |, [21% are analytic functions on go. Therefore it is clear from Lemma 8 
that m(D) —|£|-4Do|¢|* (DEeD(3.)) as differential operators on 3. Put 
o=|f[tor. Then o is a locally invariant distribution on 3. and d(1,)o == 0 
for well (Lemma 17 and Theorem 2). Put B—J(.)U, where U, is the 
space of all elements in /(3.) of the form u, (uc U). Then it follows from 
Lemma 19 and condition 2) of Theorem 3, that dimI(a,)/8 <œ. Moreover 
it is clear that 6(v)o—0 (ve V). Since H,30 and g is semisimple, we 
know that dimg<dimg. Therefore c= 0 by induction hypothesis. This 
proves that op—|{|-tc—=0 and therefore T —0 on Q. 

Thus we have now shown that no element of g, which is not nilpotent, 
can lie in Supp T. Therefore Supp T C A MQ in the notation of Theorem 4 
of [2(e)]. Since the Killing form o lies in I (go), we have 0(w)T = x(w)T. 
Therefore T ==0 from Theorem 5 of [2(e)]. This completes the proof of 
Theorem 3. 
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FUNDAMENTAL SOLUTIONS OF INVARIANT DIFFERENTIAL 
OPERATORS ON SYMMETRIC SPACES. 


By S. HzLeAson.* 


1. Introduction and notation. Let D be a differential operator on R” 
with constant coefficients. A fundamental solution for D is a distribution T 
on R” such that DT =ô where 8 is the delta function on R". Such a dis- 
tribution, whose existence is well known, gives by convolution a solution of 
any equation Du—f on R”, f being any C” function of compact support. 

Let D be an arbitrary differential operator on an arbitrary manifold M. 
In general the differential equation Du— 0 has no solution, not even locally. 
This remains true when M is specialized, unless D is appropriately specialized, 
too. 

In this paper we consider the case when M is a symmetric space of the 
noncompact type, that is a manifold G/K, where G is a connected semisimple 
Lie group with center {e} and K a maximal compact subgroup. Since a 
differential operator on R” with constant coefficients is characterized by its 
invariance under translations, a natural restriction on the differential operators 
on @/K is invariance under the action of G. A fundamental solution for 
such a differential operator D is a distribution T on G/K such that DT =ô, 
where 6 now denotes the unit mass at the point left fixed by K. In this paper 
the existence of such a fundamental solution is proved (Theorem 4.2; see, 
however, the introduction to $4). A fundamental solution for D imme- 
diately gives a global solution of the differential equation Du = f, where f is a 
C” function with compact support. 

The definition above of a fundamental solution can of course be extended 
to more general coset spaces. However, for compact spaces, a modification 
is necessary in order to take into account the nullspace of the operator (cf. $6). 

The proof of Theorem 4.2 leans heavily on Harish-Chandra’s theory of 
spherical functions on the group Œ. Section 2 summarizes the required results 
from this theory, combines these with a recent important contribution of 
Gindikin and Karpelevit, and states some simple consequences. Theorem 3.8 
shows that the action of the G-invariant differential operators on @/K on 
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the radial functions on G/K is isomorphic with the action of certain differential 
operators with constant coefficients. The isomorphism in question is used. in 
Harish-Chandra’s work on the Fourier analysis on G ([13], p. 595) and is 
related to the Radon transform on @/K. For the case when G is complex 
(85) a more direct isomorphism of this type is given in Theorem 6.2, again 
as a consequence of results of Harish-Chandra. As an application we verify 
the absence of Huygens’ principle for the wave equation on G/K, thus sup- 
porting the classical conjecture attributed to Hadamard ([6], p. 438), that 
Laplace’s equation on a non-flat Lorentzian manifold does not satisfy Huygens’ 
principle. In 86 we give a formula for the Green’s function (i:e. the funda- 
mental solution of the Laplacian) of a compact, simply connected, semi- 
simple Lie group. In §7 we investigate whether all the G-invariant differential 
operators on G/K are induced by the two-sided invariant differential operators 
on @. It is shown that this is the case when G is a classical group (real or 
complex) but fails in general for the exceptional groups. However, a weaker 
result (Theorem 7.6) is generally true. 

The main results of this paper were announced in [16] and [18]. 

The following notation will be used throughout. As usual R and C 
denote the fields of real and complex numbers, respectively. The identity 
of a group will be denoted by e. If A is a group and B a subgroup the set 
of left cosets aB will be denoted by A/B. For each v€ A, the mapping 
aB->zaB of A/B onto itself will be denoted r(x) ; the left translation a—> ra 
and the right translation a— az are denoted by L(x) and R(a), respectively. 
If M is a manifold, C* (M) (respectively C,” (M)) denote the set of C” 
functions (respectively C° functions of compact support) on M. If pe M, 
M, denotes the tangent space to M at p. If + is a differentiable mapping of 
M into another manifold N and pe M then dr, (or simply dr) denotes the 
differential of r at p, mapping My into Nr. If ~r is a diffeomorphism of M 
onto N and fE C*(M) then f* denotes the composite function for, lf D 
is a differential operator on M, [Df](p) (or D,(f(p))) denotes the value of 
Df at p. If 7 is a diffeomorphism of M onto itself then Dr denotes the 
‘differential operator f—> (Df™)7 on H. 

If A is a Lie group and B a closed subgroup then D(A/B) denotes the 
algebra of real linear differential operators on the manifold A/B which are 
invariant under the action of A. We write D(A) for D(A/{e}). Lie groups 
will be denoted by capital Roman letters and their Lie algebras by the corres- 
ponding lower case German letters. The adjoint representation of a Lie 
group A is denoted by Ad, (or simply Ad). The dual space of a vector space 
E will usually be denoted Ê or F’. 
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2. Fourier transforms on symmetric spaces. Let S be a Riemannian 
globally symmetric space, G the largest connected group of isometries of 8 
in the compact open topology. We assume $ is of the noncompact type, that 
is, G is semisimple and has no compact normal subgroup >£{e}. Let o bea 
fixed point in S, K the (maximal compact) isotropy subgroup of G at o so 8 
ean be identified with the left coset space G/K. Let f and g denote the 
corresponding Lie algebras, p the orthogonal complement of f in g with 
respect to the Killing form < , }ofg. Let exp: g— @ denote the exponential 
mapping for G and Exp: 8.— 9 the Exponential mapping for 9; the latter 
is a diffeomorphism. If ~ denotes the natural mapping of G onto G/K then 
dr maps p isomorphically onto S, and r(expX) —Hxpdr(X) for XE p. 
As is customary we identify these two spaces and write p for Se Let 
|X| == <X,X>4 for XE p. Choose a maximal abelian subspace a of p (a 
Cartan subalgebra for 9) and put A==exp(a). Let a’ denote the set of 
regular elements in a and put A’—=exp(a), S’—=K-Exp(a’). We fix a 
Weyl chamber C in a, i.e. a connected component of a’. Let % denote the 
set of linear maps of a into C, so r= {AE 8: A(a) C R} is the dual space 
of a. An element AE Fp is called positive if A(H) >0 for all HEC. For 
each AC Hp let q = {X € g: [H, X] —A(A)X for H € a} and let d, = dim(g); 
A is called a root of S with respect to a if d,40. Let 3—= {AE Be: A> 0, 
da 3 0}, let 2p == Baood,A and let 3, denote the set of elements in 3 which are 
not integral multiples of other members of Z. The algebra n= Xysog, is a 
nilpotent subalgebra of g and we have Iwasawa decompositions g == f +a +n, 
G— KAN where N=exp(n). For g€ Glet H(g) denote the unique element 
in a satisfying g € KexpH(g)N. If h—expH (H€a) we write H=logh. 

The Weyl group W of S is the group of linear transformations of a 
induced by those elements of Adg(K) which leave a invariant; W also acts 
on A via the mapping exp and on %, by duality. 

Let D,(@) denote the set of elements in D(G) which are invariant 
under right translations by the elements of K. Then we have a linear mapping 
pof D,(G) onto D(G/K) given by (u(D)f) or=D(for) for fe C*(G/K) 
([15], p. 390). We have also a homomorphism y of the algebra D,(@) onto 
the algebra I(a) of W-invariants in the symmetric algebra S(a) over a 
(Theorem 1, [13], p. 260). The elements in S(a) will be considered as 
differential operators on A in the usual manner. 

We shall now state the Plancherel formula in the form proved by Harish- 
Chandra [13] and draw some consequences of a more recent paper of Gindikin- 
Karpelevit [8]. 

For A € % let ¢, denote the corresponding spherical function ([13], p. 261) 
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and let A—>c{A) denote Harish-Chandra’s function for S which occurs in 
the leading term in the asymptotic expansion of $y that is, (cf. [13], p. 283), 
if dk is the normalized Haar measure on K, 


d (exp H) — f EODD Ddk ~ eD S e(A (sH) ) oto 
K sceW 


for H varying in a subset of the Weyl chamber Ọ and X varying in a certain 
subset of %. The function e+ is holomorphic in an open subset of % con- 
taining Şe ([13], p. 580). 

For a certain space I,(@), defined below, of complex-valued C* func- 
tions on G, bi-invariant under K, the following Plancherel formula holds. 
For fEI,(@), put 


(1) PA= f fla)en(w*)de (AE Be). 
G ` 

Then ([18], p. 611), 

(2) fa) = f IAAL 

(8) JS, tor f FW lea, 


where dz and dà are suitably normalized invariant measures on G and Sz, 
respectively, and w is the order of W. 

Now let «€ 2, and consider the subalgebra g* of g generated by the 
subspaces ge and gc. Let ft—g*Mf, prg“np. Then g” is semisimple, 
g* = f* -+ p* is a Cartan decomposition and the corresponding symmetric space, 
say. S*, has rank one. For a Cartan subalgebra of this symmetric space-one 
can choose a*==p*Ma. For Ace %, let Aa denote its restriction to a%. If ce 
denotes the Harish-Chandra function for S* then, according to Gindikin- 
Karpelevié [8], = 
(4) Ay [| a 9a). 


For each a€ Jo select Ha€a such that <Ha Hy —a(H) for wt Hea. 
Then HE a“. As shown in [8], e(A) =I (ià)/I (p) where 


Pa Pazz (v,a) 
Kl + ee) 





B. is the Beta function (z,y)—>T(z)T(y)/T(z-+y), and pa is the multi- 
plicity of a. For the space S*, 3, consists of just one element, say y. Then 
2y is the only other possible element in ¥. Denoting their respective multi- 
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‘plicities by p, and pa the Killing form of g* by ( , )a, the furiction ca(A«) 
becomes TE 





2 B Ag; Ja P2 Pı > (Aa, 2y)a 
Ca (Aw) == I> “p(B i Y Ja > 14 ———— |, 
Ne) (e ) 2 (y y)e 2 4 + (2y, Ry) a 
where p“ is the function p for S*. If ps0, the last factor does not occur. 
. In any case we have f 
T (ita (Ha))  T(a, + tara (Ha) ) 
T (ta + 2idsħa(Ha)) T (as + itzda(Ha)) ’ 


where the a, are constants > 0. 

Consider now the polynomial function += I] Ha on § (cf. [13], p. 

ae 
252). Then 
(6) e(A)z(X) = II ca(àa)Ha(à) = II ca (Aa) Ae (Ha). 
22) WEL 

Because of (5), ca has a simple pole at the origin. Thus e(A)r(X) is holo- 
morphic and 40 for A==0. This means that r, in Lemma 29 in [13] p. 580 
actually is a constant multiple of m. This shows that the space I,(G@) in [13], 
pp. 611, 586, consists of all functions ġa of the form 





(5) Ca (àe) — U 


(1) salt) = f daaa), 


where a belongs to the space 2 (r) of complex-valued rapidly decreasing C* 
functions on %r ([27], p. 89). Let (Fr) denote the set of W-invariants in 
2 (Fr). Let DED, (G); then Dd, = -y(D) (tA) da ([13], p. 262) s0 D leaves 
the space I,(@) invariant (cf. Theorem 3, [13], p. 586). Let the positive 
functions » on p, A and A, on a be determined by 


o f Oef Eaa f, sent f, Neena 


(9) J Fax aan, FAA) ak, 


f and F being continuous functions of compact support and dp, dX, dH being 
the volume elements induced by the Killing form. For each integer q = 0 
let oa(2) =o (X) (1+ | X |)" if r= kexpX (ke K,X €p). As in [18], p- 
585, let I(G) denote the set of all complex-valued C” functions f on @ which 
satisfy the following two conditions: a) f is bi-invariant under K ; b) for each 
DED(G) and each integer g>0 


ro,a(f) = sup lose) [Df] (#)| <>. 
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The collection of all seminorms rp,, turns I(@) into a locally convex space. 
Also I,(@)C I(@) and the mapping a— 4, is a continuous mapping of 
3 (fx) into I(@) (ef. [13], p. 586). 

Next we consider the integral transform 


Ph) = een f’ F(hn) dn, feI(@),hEA, 


dn being a suitably normalized invariant measure on N. This integral trans- 
form is used in [13], pp. 595-596 where it is shown that 

(i) The mapping f— F; is a continuous mapping of I(@) into the 
‚space I(A) of W-inyariant rapidly decreasing C* functions on A with the 
usual topology. 

(i) | 

(A) -f Fi (h) oshdh, fEeI(@),hEA. 
A 

with an appropriate normalization of the invariant measure on A. 


The space I(A) is of course an algebra under the convolution product 
on A. 


Lexma 2.1. Let DED(G) and if fe 0*(@) let 
Pla) = Sfr) dk (z€ 6). 


Then there exists a constant Mp and finitely many operators D, > -, Dpi) 
in D(@) such that the uniform norm | |. on G satisfies 


(10) | Df lo £ Mo È | Di le for all f€ 0,” (@). 
Proof. Let D,,-  ‘,D, be a basis of the subspace of operators in D(@) 
of order Sorder (D). I£ ze G, then DE") — Sai(2)D where m € C° (G). 
Hence 
[DF] (x) -3 Í. =)D] (kek) dkak 


and (10) follows. 


| Lemma 2.2. Let I(G)=I(O) N0. (G). Then I,(G) is a dense 
subspace of I(@). i 
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Proof. There exists a sequence (&) C Co” (G) and an increasing sequence 
(U;) of open subsets of G with union G such that 

(G) Bla) = 1 for z€ Ọ;; : 

(ii) For each DE D(G), | Dẹilo < c(D) where c(D) is constant 
which only depends on D. 

A proof can be found in Langlands [22], p. 119. Replacing & by t 
and U, by the open set {ve G: Kak C Uj} we may, by (10), assume that 
each d, and each Ọ; is bi-invariant under K. 


Now let fEI(@), De D(G@) and q an integer =0. We shall show that 
to,q(f —fd¢s) 20 asi>w. It is clear that 


(11) D(f—f¢s) =È (Daf) Es (1 — 4) (finite sum) 


where De, EgE D(G). Let e> 0 be given and let N (independent of +) 
denote the number of terms in (11). Then by (ii) there exists an index « 
such that for all «a, 8, i 


(12) „E29, [ort [Daf] (2) [E0 —4)] (2) < 


Since Es(1—¢+) vanishes identically on Ui if 12% it follows from (11) 
and (12) that 
Toalf — fh) <e if 12i. 


3. The transmutation operator. Since the Weyl group W permutes the 
elements in 3 U (—X) it will also permute the elements in 3,U (—%). 
It follows that for each se W, m= e(s)r where e(8) =+ 1. A function a 
on r is called skew if at =— e(s)a for all se W. 


Lema 3.1. Suppose a€ A (Fr) is skew. Then a == ra, where mE d(e). 


Since a is skew it vanishes identically on each hyperplane Hae(à) = 0 
(«€ 3) in r; (ef. [13], Lemma 10, p. 252). Choose a basis (z,,' - +, 2%) 
of a (dual of r) such that t, ==Ha. Then a(0,%,---,2;)—=0 80 
a(z * +, T1) = Tab (La, + tT) for 


1 
as m), [Da] (28,2 + +21) ds, 


where D, denotes differentiation with respect to the first argument. Thus 
a — Hab where bE 3 (Fr) and the lemma follows by iteration, since no two 
elements in 3%, are proportional. 
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‘PROPOSITION 3.2. The space.I,(@) is an algebra with respect to the 
convolution on G. 


Let a $» be arbitrary elements in I,(@), where ,bed(fr). Let 
A*t= expC. Then for a suitable normalization of the invariant measure dl 
on A we have for z€ G, ((8), (9) $2), 


pralo = fy METS S HOAN fy dalek) aka. 
Now 


(1) Sea f ak f kr) 


and since | ¢,(r)| S 1, and a(à) rapidly decreasing we may interchange the 
order of integration in (1). Using the functional equation for the spherical 
function it follows that 

2) gpa = f ADAD f ANANE) 


Let the norm of the linear form A€ % be. denoted by |A|. Now as shown 
in [13] p. 611 there exists an integer k = 0 and, for a fixed b, a positive 
constant L such that for A€ Ir 


[RO] [| AOAIE [ale 
Consequently l 
SI HOAD AANA) | add 
< L(1 k T 
S f OHIAN aAA) a 
which is finite; thus the integrals on the right hand side of (2) can be inter- 
changed so we obtain 
| dtl) = f AAAA 
But (i) and (ii) in §2 show that $€ ð (8r) so 
(8) patho = go where c= app 
and the proposition follows. 


THEOREM 3.3. The mapping f— F; is a topological isomorphism of the 
algebra Io(G) onto the algebra I(A). Furthermore, 
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AM). | Fo,—y(DJF, 
for DED,(@), FELG). 


- LEMMA 3.4. Letfe I,(G) and Dé D(G).. For each compact set 9 C G 
the integral ° 


(5) fF ng) an 
converges uniformly for g € Q. 


Writing g — nak, where n€ N, a€ A, k€ K, we have with the notation 
from the proof of Lemma 2.1, 


J, (DAL (ng) dn f (DAE (rma) dn 


~Z a(k) | [Def (nea) an. 


Therefore it suffices to prove that (5) converges uniformly as g varies in a 
compact subset of NA. But this is guaranteed by Cor. 2, p. 593 in [13]. 

In order to prove (4) let ge G and denote by A(g) the unique element 
in a such that ge NexpA(g)K. I£ hE A, the automorphism n— hnh of N 
has Jacobian at e equal to the determinant of Ad(h) restricted to n, i.e, 
e(lozh), Hence 


(6) J, f (nh) dn — etoos®) J i (lin) dn (he A) 
so the function 
Fr(g)—ereeao) | f(ng)dn 


is an extension of Fy to a C” function on G. Using Lemma 3.4 we have 
D(eWsaonp*(g))— f [Df] (ng) an. 
N 


The function g— erlosA@)F*(g) is invariant under each substitution g — ngk 
(neN,keK). From Theorem 5.2 in [17] we therefore obtain 


(Da) a (0DF (h)) — f [DF] (mh) dn (he A) 


where Da == ee oy(D) 06%, Since F;(h) == F*(h) we obtain (4) by a second 
application of (6). Next (2) and (ii) in §2 show immediately that the 
mapping f— F; is one-to-one on I,(@). l 
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Next we prove that f-> F; maps I,(@) onto I(4). LetweI(A). Then 
the Fourier transform 


Ef, yaeta (A€ Ba) 
is a W-invariant function in g(r). Consider now the integral 


fla) ur f GA)ga(a) ea) [aa (ze @) 
oa 
whose existence is assured by the following lemma. 


LEMMA 3.5. There exist positive integers a and b such that 


1 
ei laly, AE Se. 
a| ="! + | |) OR 
In view of (5) and (6) §2 this is contained in the following lemma. 


LEMMA 3.6. Let a and b be any positive real numbers. The function 
son R given by 
s(2) =T (a + is) (T (b + t))* 
has each of its derivatives majorized uniformly by a polynomial. 
Proof. Using the formula 


T (2) al 1 
TO Fanta) Ih 


where y is Euler’s constant, we find that 








.s (2) 1 1 2 1 
vera re le) ae) 
le 1 
neuerer 
80 
(7) s (2) =s(2)t(2) 


where t(z) is a function each of whose derivatives is bounded by a polynomial. 
On the other hand, for each fixed real number c we have for v real, 


(8) A T(e +2) |exp (4 | z |) | a |i = (2r)? 


(see e.g. [30], p. 151). This equation shows that s(z) is uniformly bounded 
by a polynomial. Now the lemma follows from (7) by induction. 
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The formula for f(x) can be written 


f(x) —w f IDAEA f ara, 


where 
a(A) =wty(A)r(A){e(A)m(A) conj(e(A)r(A))}", 


conj denoting complex conjugation. In view of (5), (6) §2 and Lemma 3.6 
the function a belongs to 3 (r) so 


(9) f= do 
Now the following lemma implies fj =f and therefore F; = y. 
Lemma 3.7. Suppose a€ 3 (Yr) is skew. Then 


m(A)ba(A) =w | e(A) |? | (A) |? a(A). 


This lemma is an immediate consequence of Theorem 5 in [13] p. 610 (since 
mr). 

Since (ff) —=fife (fi fe€Io(G)) formula (ii) 82 shows that the 
mapping f—> F; is a homomorphism of I,(@) into I(A). 

As remarked earlier the mapping f—>F, is continuous. Thus it just 
remains to prove that its inverse is continuous. Since da==dı for A€ Fr 
and se W we may, replacing a(X) by w 2 <(s)a(a) in (7) 82, always take 

8E 


a(A) skew in the definition of ¢e- Since the Euclidean Fourier trans- 
form is a homeomorphism between the spaces of rapidly decreasing functions 
we just have to prove that the mapping f>f of I,(@) onto A(%r) has a 
continuous inverse. Now f—d, where a is a skew function in 3 (e) 
which is unique because f(A) =w|e(A)r(A)|?a(A)r(A)*. The mapping 
h—>|ex|?h is a homeomorphism of A(fr) onto itself so the question is 
reduced to the continuity of the mappings 


d>rd of (Fr) into æ (Fr). 
a> ba of (r) into I,(G). 


The first is obviously continuous and the continuity of the second was men- 
tioned in §2. All the statements in Theorem 3.3 have now been verified. 

The operator X: f>F, is a simultaneous “transmutation operator” for 
the differential operators in D,(G@) in the sense that it transforms a function 
space on which the DE D,(@) act isomorphically onto another function space, 
where these differential operators act with constant coefficients. 
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4, Applications to invariant differential operators. . At the end of 
his paper [13], Harish-Chandra states the following two conjectures which 
would imply the Plancherel formula (3) §2 for all fel(@). - 


(I) There exists a polynomial p on Yr such that | e(A)r(A)p(a)| 21 
for all XC Be. (Here we have used m= m, proved in $2). 


(I) The mapping f— F; is one-to-one on I(G). 


Now (I) is a consequence of formulas (5) and (6) 82 together with 
Lemma 3.6. In view of Theorem 3.8, (II) is equivalent to 7)(G) =I(@). 
On the other hand, the Plancherel formula (3) 82 for all fE Z(G) together 
with (ii) §2 clearly implies (I). ` 

Now I understand that Harish-Chandra has proved the Plancherel for- 
mula (3) §2 for all f€ Z(G) in a recent, as yet unpublished, work. In this 
section we ‘shall therefore assume that J,(G) —I(@). 

_If E is any differential operator on @, the adjoint #* of Æ (with respect 
to the measure dz on G) is given by 


J ENO S fe) (Bt) (ede fige (@). 


If 7 is a distribution on G then ET is by definition the distribution f> T(E*f). 
If T4, T, are two distributions on @, their convolution T, + T3 is the functional 
on O.” (G) formally given by (provided the right hand side makes sense) 


(Tı + Ta) (f) = S genen: warıw). 


If at least one T; has compact support then 7,+T, is another distribution 
on G. For this and several other formal properties of distributions on G, 


see [9], §4. In particular if 8x denotes the distribution f> J i(k) dk on 
G we have for fE C.” (@) = 


fein) f j(k) dk, ze. 


_ On the space G/K the adjoint operation D> D* on differential operators 
is defined by means of the G-invariant measure on @/K induced by the 
invariant measure de on @ and the differentiation of distributions is defined 
just as above. If T is a distribution on G/K, T denotes the distribution on 
G@ given by T'(f) =T (fx) where f€ C,” (G) and fr is the function on G/K 
given by fror—=f#dx. In particular, if Fe 0,” (G/K) then F— Fon and 
if 8 denotes the distribution F>F(o) on Q/K then $==dz. Moreover, the 


INVARIANT DIFFERENTIAL OPERATORS. 577 


convolution of distributions on G induces an analogous operation.X for dis- 
tributions on G/K. In fact, if Tı, Ta are two distributions on G/K, at least 
one of the compact support, then T, X T, is the distribution F> (T, +* Ta) (F) 
for Fe C,"(G/K). 

Definition. Let DE D(G/K). A distribution T on G/K is called a 
fundamental solution for D if DT =6. 


Proposrrion 4.1. Let DED(G/K) and FEC.”(G/K). If T wa 
fundamental solution for D then the C” function u=F XT is a solution 
of the equation 

Du = F. 


Proof. Let f€ 0” (G) and let 8 be a distribution on G. Let f’ denote 
the function > f(x) and 8° the distribution f—> S (F) (fe 0.” (G)). Let 
EE D(G) and let eg the distribution f —> [EF] (e). Then 


(1) Ef=f*e, 
(2) ESS * ex. 
In fact 
f * ez (2) =f f (ay) dea (y) = en (f0) = [Ef] (e) = [Ef] (2). 
Secondly, 
(ES) (f) = S(E*f) = (S* (E*f)’) (e) — (8 #(f *exe)’) (6) 
== ( (8# (ex+)’) #7’) (e) — (S* (er) (F). 


If Y is a left invariant vector field on G then Y*==— Y so (ey-)’==ey. If 

E,#,€D(@) then (1) shows that cms, == <n, * cn, Also (E,E,)* = E,*E,* 

and (5,+*92)’==9,/*8, if S,, 8, are distributions on G with compact 

support. These formulas combined show that (eq+)’—ep so (2) follows. 
Since 


feS(a)— Jf Peast) 
it follows easily that (FXT)oa—F*T. Select E¢€D,(G) such that 
u(#) D. Then 
(D(FXT)) on=E((F XT) on) = (Fe) ep = Fe ET 
Now »(E*)== (n(E))* and B*e D,(G). It follows that if fe 0,” (@), 
(ET) (f) — T(H*f) =T ((E*f)e) =T (D*fx) = DT (fr) = ôx (f). 
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Thus E 
(D(F X T)) or =F + 8g æ F or, 
which proves the proposition. 


THEOREM 4.2. Let D be a nonzero differential operator in D(G/K). 
Then there exists a fundamental solution for D. 


Consider the transmutation operator X: f —> F; which is a linear homeo- 
morphism of /(@) onto I(A). Its transpose, *X, is a linear homeomorphism 
of the dual space I(A)’ onto the dual space I(@)’. Now I(A)’ can be 
regarded as the space of W-invariant tempered distributions on the Euclidean 
space A ; in fact if SE [(A)’, the linear mapping f —> S (w zn) (fe 0,*(A)) 


is a W-invariant distribution on A, which determines 8 completely since the 
space I,(A)=I{A)NC,*(A) is dense in I(A). This distribution can 
therefore be denoted by S. Each De S(a), considered as a differential 
operator on A, with adjoint D*, acts on I(A)’ accordingly: (DS)(f) — S(D*f). 
Similarly, the elements of I(@)’ can be regarded as distributions on G, 
bi-invariant under K. In precise terms, let f€ C,~(@) and let fi be as in 
Lemma 2.1. If TEI(@)’ we see easily from (10) §2 that the linear 
mapping f>T(f*) is a distribution on G. Since I,(G) is dense in /(@), 
(Lemma 2.2), this distribution determines T uniquely and will therefore be 
denoted by T. Now select Æ € D.(G) such that „(E) =D. The distribution 
ôx clearly belongs to Z(G} so there exists a unique element «€ F(A)” such 
that ‘Xe== ôx. By theorem of Hérmander [19] and Lojasiewicz [23] each 
nonzero differential operator with constant coefficients on R” maps the space 
of tempered distributions onto itself. In particular there exists a tempered 
distribution $ on A such that 
y(E*)#S =e. 


Both y(#*)* and « are W-invariant so we can also take S invariant under W, 
that is, SEI(A). Put T,<—4X(S); then TÄEI(@)’ and if fe CO,” (@) 
we have 
TE) = TEN) == X (E* f) —= 8 (XE*f) = 8 (y (E*) XF) 
= (y(B*)*8) (XP) = (Xe) (F) = 3x (F) = èx (f). 
This proves that 
(8) ` ET, = 8x. 


The proof of Theorem 4.2 is now easily finished. Let T denote the linear 
functional 


F>T,(For) Fé C*(G/K). 
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Then T is a distribution on G/K and T,=T. Also 


(DT) (F) = T(D*F) =T;((D*F) or) 
== T,(E*(For)) = (ET,) (For) —8x(Fox) =F(0). 
Thus 
DT =ô 
and the theorem is proved. The proof of (3) has the following corollary. 
COROLLARY 4.3. Let E be any nonzero element in D,(G). Then 
G) E maps I(G)’ onto itself. 

(ii) E ts a one-to-one mapping of I(@) into itself. 

The first part is proved exactly as formula (3). For the second part, 
suppose f€I(G) such that Hf—0. Then X(Ef)=y(E)Xf—=0. Since 
Xf and y(E)Xf lie in I(A) we obtain by taking Fourier transform, Xf = 0 
s f=0. 

PROPOSITION 4.4. Hach D340 in D(@/E) is a one-to-one mapping of 
0.” (G/K) into itself. 
Proof. Suppose F € 0,” (Q/K) satisfies DF =0. Let 


1*(02) = f P(gke-0) dk, 12€ 6, 


and select ZED,(@) such that »(#) =~ D. Then by the Darboux equation 
[15], p. 443 i 


(4) © Ba(f*lga)) = f [DF] (gk: 0)dk=0. 


For each fixed g, the function s—>f*(g,x) is an element of I(@). By Cor. 
4.3 (ii) and (4), f* (9,2) =0 for all ve @. Putting z = e, it follows that 
Fm Q. 


5. The case of a complex group G. In this section we shall assume 
that 8 is a Riemannian globally symmetric space of the noncompact type for 
which the group @ is a complex Lie group. In this case we give an inversion 
formula for the transmutation operator X: f>F;, and a representation 
formula for the differential operators in D(G/K), which leads to a sharper 
version of Theorem 4.2 and certain applications. 


THEOREM 5.1. Let O be any element in D,(@) such that y(D) =". 
Then the inverse of the operator f— F; of I(@) onto I(A) is given by 


8 
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(1) Dol f #y(exp(H(gh))) arten ak) — of (9) 
where c is a constant 40, independent of f. 


Proof. Suppose first that f has compact support. Then 
J Fr(oxp(H(gh))) oem ar — f ak f flexp(H (gk) )n) dn 
K 


= f, S, How) dnak, 


since dn is invariant and f is invariant under left translations from K. The 
last integral equals I;(g) in the notation of [17], §6 and (1) follows from 
Theorem 6.1 in [17]. Now if fEI(@) is arbitrary there exists a sequence 
(fn) of elements in I,(@) which converges to f (in I(@)). Then the 
inequality in Cor. 2 of [13], p. 593, shows that for each De D(A), DF,, 
converges to DF; uniformly on each compact subset of A. For a€ A the left 
hand side of (1) can be written 


8 (2). f. Fy(exp(H(ak))) arme di 


where X(D) is a certain differential operator on A’ (cf. [13], Lemma 23, p. 
265). From these statements it follows that (1) is valid on A’ for each 
feI(@). But KA’K is dense in G so (1) holds on the entire @ by continuity. 

` A function F on S=G/K (or p) will be called a radial function if 
Fr® —F (or FAH — F) for all k¢ K. Similarly radial distributions are 
defined. Let I(p) denote the algebra of radial polynomial functions on p. 
If we combine the isomorphism of D(G/K) onto I(a) ([13], Theorem 1, 
[15], p. 432) with. Chevalley’s restriction isomorphism ([15], p. 430) of 
I(p) onto I(a) we obtain an isomorphism A of D(G/K) onto I(p). 


Tarore 5.2. Let F be any radial 0” function on G/K and D € D(G/R). 
Then i 


r ; 
(2). _ (Df) ° Exp == MD) (o(Fe Exp) ). 

Proof. Let # denote the function on a given by F(H)=F(ExpH). 
Then Lemma 55, p. 305 in [13] (cf. also [3], Theorem 28), can be stated 
(3) (DF)- = AAT(D) (AP) (on g). 


and Theorem 1 in [12] implies 
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(4) (MD) (Fo Exp) )-— Astr (D) (AAF) (on er). 
Now T = A/Ao so by (3) and (4) l 
_ (DF) = AAT (D) (AP) — AAT (D) (ASP) — 34 (A(D) (o (F o Exp) )-., 


This proves formula (2) on the.set a’. By continuity, it holds on a. But 
both: sides. of (2) are radial functions so (2) holds on the entire space p. 


Remark. I am indebted to B. Kostant for conversations which raised 
the question’ of a formula of the type of (2). For the bi-invariant differential 
operators on any real semisimple Lie group a local formula similar to (2) 
has also been proved by Harish-Chandra. ' l : 


~ As a consequence of Theorem 5.2 we can now prove a sharper form of 
Theorem 4.2. 


Turorzm 5.3. Let D€D(G/K). The radial fundamental solutions 
Q for D are the distributions i 


Q: F>Q.(o(F°oExp)), ! Fe 0," (@/R), 
where Q, is an arbitrary radial fundamental solution for A(D*)*. . 

Proof. Let I,°(@/K) and I,” (p) denote the spaces of radial ce 
functions on G/K and p, respectively, equipped with the topologies induced 
by C.” (G/K) and C.” (p). Their duals can be indentified (compare $4) 
with the spaces of radial distributions on G/K and p, respectively. The 
mapping i . di 

Y: F—o(F o Exp) 
is a linear homeomorphism of I,” (@/K) onto I,” (p) and according to (2), 
(5) ` YDF =\(D)YF | 
so Y is a simultaneous transmutation operator for the differential operators 
in D(G/K). The transpose *Y is a linear homeomorphism between the men- 
tioned distribution spaces. In particular, the distribution (*Y)-*(8) is the 
delta distribution 8: f>f(0) on p. . Now let Q, be any radial distribution 
on p. Then the equation 

A(D*)*Qo = èo 

is easily seen (by (5)) to be equivalent to the equation 


D('YQ.) =8; 
this proves the theorem. 
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. Examples. 


I. The Laplace-Beltrami operator on S. Let A and A, denote the 
Laplace-Beltrami operators on $ and p respectively. As pointed out in [15], 
p. 451, A is the image under the mapping p of the Casimir operator in D(@). 
Therefore, if we use Cor. 2, p. 271 in [13], we see that A(A) == As — | p |’. 
Now A* == A, Ao* = Ao, and a well known fundamental solution of Ay— | p |? 
is given by 
(6) Qo(X) = 24da (i| o || Z FEN nel | XI), 


where n = dim (p) and N, is the Neumann function (see e. g. Schwartz [28], 
Exposé 8). Thus |X |"Q,(X) is bounded near the origin X=0 80 Qù is a 
locally integrable function on p. 


THEOREM 5.4. The Laplace-Beltramt operator A on S has a locally 
integrable fundamental solution Q given by 


(7) Qo EXP =o Qo, 
where Qo is given by (6). l 


In fact, the fundamental solution Q for A given by Theorem 5.% is 
locally integrable on S and satisfies for all FE C.” (8) 


af, OPi = f, Q(BxpX)F (Exp X)o"(Z)aX, 


Q(F) = Qo(o(FeBxp)) — f° Qo(X)o(X) (Po Exp) (X)AX, | 
so Q o Exp == wQ, as stated. 


Remark. For the case when S is the space of positive definite Hermitian 
mX m matrices a formula of the type (7) was given without proof by 


Dynkin [7]. 


II. The wave equation on 8. Absence of Huygens’ Principle. In [17] 
the solution of the Cauchy problem for the wave equation (A — 02/01?) u = 0 
on § is written down. However, the solution formula, although explicit, 
seems too complicated to settle immediately the question whether Huygens’ 
principle’ holds for the wave equation on 8. This can be answered in the 
negative by using the representation of A in Example I. 


2 For a discussion and results concerning Hadamard’s problem about the occurrence 
of Huygen’s principle, see e. g. Hadamard [10], p. 236, Stellmacher [26], Asgeirsson [2], 
Helgason [14], p. 206. 
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According to Hadamard, Huygens’ principle cannot hold if n == dim S 
is even. Hence we may assume n odd. The equation 


Ao — | p |? 8/0?) u— 0 


-for damped waves in the Euclidean space p has in the interior of the retro- 
grade light cone 


D= {((X,t) ep XR: P—|X |? > 0,t <0} 
a solution of the form 
(8) -u(X,#) = U(X, t) (P—| X |?) + V(X, t)log(? —| X |°), 
where the functions U and V are bounded for small X and ¢ and V(0,0) 40 
(cf. Hadamard [10], p. 107). Replacing X in (8) by Ad(k)X and integrating 
over K we may assume that U and V are radial functions in the variable X. 
Now consider the function F given by F(Exp X,t) —o(X)“*u(X,t) for 
(X,t) € Do. Since A(A) = A,—|p |? we have from (2) 


[(A—22)F] (Exp X, t) — [AF] (Exp X, 0) i ae t) 


oF 


== 0(X)*[(4o—| p Yu] (X, #) —0(£)* Fu) =0 


a 


so the function F satisfies the wave equation in the interior of the retrograde 
light cone 


D,—{ (ite 7.1) €8 XR: (X, t) eps: 


Let r denote the Lorentzian distance of (Exp X, t) from the origin in S X R, 
i.e, r(Exp X,t) = (#?—|X|*)§. Then F is a solution of the wave equation 
in D, of the form 


F(p) —U,(p)r(p)** + Vı(p)logr(p) (p€ Do) 


where V,(0) 540. This means that Huygens’ principle is absent (cf. Hadamard 
[10], p. 236, Courant-Hilbert [6], p. 438). 


6. The Green’s function of a compact semisimple Lie group. Let M 
be a compact Riemannian manifold of dimension m, Co” (M) the subspace 


of f€0*(M) which satisfy f f(x)dx-=0, de denoting the Riemannian 
e M 


measure on M. The Laplace-Beltrami operator A on M is an isomorphism 
of Ca” (M) onto itself. The inverse operator, say T, is an integral operator 
whose kernel, the Green’s kernel of M, is a differentiable function outside the 
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diagonal of M X M and is characterized by the following conditions (see de 
Rham [24], p. 157): 
(i) gay) =g(y,%) for cAy in H. 


(ii) d(x,y¥)"*g(z,y) is bounded, d denoting the distance on M. 
(If m=? this condition should read “(log d(z, y))“g(z,y) is bounded”). 


(ii) [EA (e) = fF g(a) fla)dy for all fe Ou" (M). 
(iv) f g(enay=o. 


Now suppose M is globally symmetric and let U be the largest connected 
‚group of isometries of A in the compact open topology. Then U is compact. 
Fix a point o € M and let K be the isotropy subgroup of U at 0, so M==U/K. 
If g is the Green’s kernel of M it is easy to see that for each u € U, the function 
(z,y) >g(u-z,u-y) also satisfies (i)-(iv) so g(x,y) =g(u-z,u-y). Now 
define the function yon Af— {0} by y(z) =g(a,0). Then y(k-2) =y(z) 
for kE K,z~o0in M. The function yon Al — {0} will be called the Green’s 
function of M. Because of (ii), y is an integrable function on M. Let |M | 
denote the total volume of M and ö the distribution f—>f(o) on M. 


THEOREM 6.1. Let M be a compact Riemannian globally symmetric 
space. The Green’s function y, considered as a distribution on M, ts charac- 
terized as the unique solution of the equations 
(1) yo, y(1) =0. 

| M | 


For each function fon M—U/K let f=for, where r: U>U/K is 
the natural mapping. We normalize the invariant measure du on U such 


that | U | == f du equals |M |. For two distributions T,, Ta on M, T, X Ts 
U 
‚is defined as in §4. Then if fe C° (M) and ue U, 


GX) (wo) =f Ho) yoru) de— f Pogu: oo)do 
= f f(v-0)g(u-o,v-0)dv— f f(e)g(u-0,2) de 
U S M 
= f wo 2)fo(a) dé = [Tf] (u-0), 


where we have put fo =f — | M |” f f(z)dz. It follows that 
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AEX DN =f S fee der). 


Now there exists an operator AE D(U), invariant under all right translations 
by elements of K, such that A(for)=Afox for all fe C” (M) (ef. [15], 
p. 390). Computations, analogous to those of the proof of Prop. 4.1 show 
that (* denoting convolution on U), 


(A(fX 7) ox — Fey, | pecs (i) 
(Ay)~ = Ay 
80 k 
(83) . A(fXy)=fX Ay fe or (M). 


Next let s denote the geodesic symmetry of M with respect to o and let o 
denote the automorphism u— sus of U. Let fi denote the function on M given 
by the average, 


fa) = f fez) dk 


and if F is a function on U let F” denote the function u—> F(u*) on U. If 
F is bi-invariant under K then F = F° since o(u) € Ku“ K for u€ U- Since 
som==r0 (cf. [15], p. 174) it is easy to verify (((f*)")~)*== (f2)~ for 
fec"(M). Consequently, by (2) and (3), 


(F X Ay)(0) = (f! X Ay)(0o) = ((f*)* X Ay)(o) 
= (FAN) = (Ay) ((((f2) Y = (Ay) (7) 
= Ay(f*) — Ay(f) 
so 


(4) (FX Ay) (0) — Ay(f) fe 0" (M). 


Now (1) results from formulas (2)-(4). On the other hand, suppose y, is 
another distribution satisfying (1). Then y—y, satisfies the elliptic equation 
A(y—yi) =0. By the regularity theorem for elliptic operators (see e. g. 
[19], p. 178) y— y: is a O” function on M, hence a constant which must 
be 0, because y(1) = y (1) =0. 

In the case when M has rank one, y is determined in more explicit terms 
in [15], p. 447. 

Suppose now U is a compact, simply connected semisimple Lie group 
with Riemannian structure induced by the negative of the Kiling form < , > 
of the Lie algebra a of U. We shall compute the Green’s function of U. Let 
t be any maximal abelian subalgebra of u and let T=exp(t); T is taken 
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with the Riemannian structure induced by that of U. Let tẹ denote the unit 
lattice {H € t: exp H = e} in t and let A, denote the lattice of complex-valued 
linear functions A on t satisfying A(t.) C 2riZ, where Z denotes the set of 
integers. For each A € A, the function e on T determined by e\(exp H) == e®) 
(Het) is a character of T. On the other hand, each character x of T arises 
in this manner from a unique A € A, so A, can be identified with the character 
group of T. If f is a function on U, let f denote its restriction to T. 

The superscript denoting complexification we consider the set of roots of 
the complex Lie algebra u° with respect to the Cartan subalgebra te. Suppose 
the real vector space spanned by the roots is ordered by means of some Weyl 
chamber C in tt (ef. §2) and let p denote one half of the sum of the positive 
roots. Let W denote the Weyl group of U; it acts on T and on t. If se W 
let «(s) denote the determinant of s acting on t. It is well known that p€ A, 
and s(t,) C te for each se W so the function j == $, «(s)6 is a well-defined 
function on T. er 

The extension of < , > to a bilinear form on u’ X u’ is the Killing form 
ofu’. If A is a linear form on t’, let Hy € t° be determined by <H), Hy == A (H) 
for Het. If H € tt we put |à] =<Hn Hayè. Then Hp€ C since p> sp 
for s6 in W. l 


Lemma 6.2. The orbit of p under W coincides with the set of elements 
in A, of norm |p|, i.e., 


{sp: s€ W} = {A€ Ao: |A| =| p |}. 


Proof. Consider the subring A of C” (T) generated by the functions - 
eP (we A,). A function fe C*(T) is called skew if fPf—e(s)f. It is well 
known and easily proved (cf. Lemma 3.1) that if feC*(T) is skew then 
fem jfı where fie C” (T) and if fE A then fi€ A. Now suppose A€ A, and 
|A|=|p|- Then 

e(s)eR— J e(8)#? E ayer. 
sew seW B 
Now suppose a, 3&0 for some u >O in Ae. Then if A, is the highest among 
the linear forms sà (s€ W) we have `o =p +p But u> 0O implies <p pò 
== (Hp) > 0 so |ào|?>]p]?+ |u]? which is a contradiction. Similarly, 
GuV if p <0 so we find that às =p, proving the lemma. 
To any distribution § on T we associate the Fourier series 


s~ a(a) er, a(A) = rs") 


EAs 
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in the usual manner ([27]). Since j divides each skew function in C*(T) 
it is easily seen that the linear form J on O° (T) given by a, tn 
aoe. 
| ToT 
for Fe C°(T) is a distribution on T. The distribution y is an integrable 
function on U and being invariant under all automorphisms of U is completely 


determined by its restriction y to T. Let T’ denote the set of points te T 
for which j(t) 0. 


KA) = piy (—1)aino-tiom (8) P) (o) 


THEOREM 6.3. The Green’s function y on U is given by 
321 
vy (yp *J) on T, 


where yp is the distribution on T given by the Fourier series 


1 A 
a ATE A 
Proof. Let I(U) denote the space of all f€ O” (U) which are invariant 
under all automorphisms of U; the space C” (U) is given the usual Schwartz 
topology and I (U) is a closed subspace. Let S(T) denote the space of skew 
functions in O” (T), topologized similarly. The mapping X: f>jf is a 
linear homeomorphism of I(U) onto S(T) and 


X (af) = (Ar + | |?) Xf fel(U), 


where A is the Laplacian on U and Ar the Laplacian on T. This formula 
can be obtained from Weyl’s classical character formula and also from Berezin 
[3], Theorem 2.4 or Harish-Chandra [13], p. 271. The transpose !X is a 
linear one-to-one mapping of the dual S(T)’ (which can be identified with 
the space of skew distributions on T) onto the dual I(U)’ (which can be 
tegarded as the space of invariant distributions on U). If we put 


t -1 1 
Fo (26-77) 


and find a solution S€ S(TY to the equation 
(Ar + |p |°) = Yo 
then y==tX (6). Using Weyl’s integral formula 


1 Tezi 2 23 
(5) arf {Me sal, FOr oa (w = order of W) 
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Y, is easily found whereupon S, can be written down as a Fourier series on T. 
Using (5) once more, and Lemma 6.2, the theorem follows. We omit the 
routine details of the computation. 


7. Restriction of the central operators in D(G). Returning now to 
the notation of $1 and §2 let Z(G) denote the center of D(G). As is well 
known, Z(G) consists of all differential operators on G which are invariant 
under all right and all left translations on G. We shall now consider the 
question whether Z(G) is mapped onto D(G/K) by means of the natural 
homomorphism u of D,(@) onto D(G/K) given by (u(D)f)or—=D(for) 
for all DE D.(G), fE C"(G/K). 

At the same time we shall consider another homomorphism of Z(G) 
into D(G/K). Since Q is a Lie transformation group of G/K we have a 
representation y of G on C°(G/K) by putting v(g)f—f™™ for ge G, 
feC*(@/K) and r(g) as in §1. This induces a representation of g on 
C°(G/K) which extends to a homomorphism, also denoted v, of D(@) into 
the algebra of all differential operators on G/K. 


Lemma 7.1. Let DED(G), gE G. Then 
v(D)v(g) =v(g)»(DRW). 


Proof. It suffices to prove this for D=Xeg. If feC”(@) we have 
for pe G/K, 


(X(f) = ie exp(— tX): p)] (0) = [v(Ad(g*)X)f](g* p) 
= [kgr] (p). 
Lemma 7.2. Let De D(G), fEC”(G). Then 
[DI] AN) = (DO om) 1(9), 
where D* is the adjoint of D. 
Proof. If g€ @ and X€ g we have 


BEIDE Fep tI) Me 


= {F(fox)(g exp (Ad(g)(—#X)))) io 
80 


(1) BAER) = [Ad(g*)(— I)E ox) ](9). 


Let X1,- ©, X, €g. We shall then prove by induction on r that 
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(2). LAN) = (— 1) [Ad(g) [£,° + -X1)(f 07) ] (9). 
For r= 1 this is proved and assuming (2) for a fixed r we have for X,€g 
Xo IN) = EI > - Xe) A) (9) 

= (É (Ea: ISP tE) 


a oe Ye ([(Ad(g)Ad(exp(tX,)(X,° - -X1))(F°=)] 
(g exp Ad(g“)(— tXo)))} 1-0 
= (— 1) [Ad(g*)({Xo, X, > -Xi})(Fo7)] (g) 
+ (1) [Ad(g*)(— Xo) (Ad(g)(Xe° +» X1)(F°-7))] (9), 


where the unique derivation of D(@) extending the endomorphism X = [Xo X] 
of g has been denoted D -> {Xo D}. But it is clear that {X,, D} = X,D— DX, 
‘so the two last expressions add up to 


(1) [Ad (g*) (Ke For]. 


This proves (2). Since G is unimodular, the adjoint X* equals —X (X € g) 
and the lemma is proved. ` , 


COROLLARY 7.8. p(D*) —v(D) for each DEZ(G). 
- In fact Z(G) is invariant under the mapping D —> D*, so (D*) 20) = D*, 


Remark. The mapping » of D,(@) into D(G/K) can be defined for 
-any connected Lie group G and a closed subgroup K, and if G is unimodular, 
Cor. 7.3 holds. 

The image of Z(G) under the mapping » (or v) will be denoted Z(@/K). 

The Killing form < , > of g induces an isomorphism of the vector space 
g onto its dual ĝ, which then extends to an isomorphism of the symmetric 
algebra 8(g) onto §(¢), the algebra of all polynomial functions on g. Under 
this isomorphism the ideal S(g)f goes into the ideal of polynomial functions 
on g, which vanish identically on p. The subalgebra S(p)C 8(g) goes into 
an algebra of functions on g which under the restriction from g to p, is 
isomorphic to S(p). Let I(g) and Z(g) denote the set of Ad(G@)-invariants 
in $(g) and S(@), respectively, I(p) and I($) the set of Adg(K)-invariants 
in S(p) and §(), respectively. 

Let u denote the compact real form u =f -+ ip of the complexification 
'g? of g. We put p,—tp and U—Int(u), the adjoint group of u. Since G 
has center {e} it can be identified with its adjoint group, whereby K is 
identified ‘with the analytic subgroup of U with Lie algebra f. Let I(ü) 
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denote the ring of Ad(U)-invariant polynomial functions on u and I(D,) 
the ring of Adp(K)-invariant polynomial functions on py. 

The subspace a, ia is a maximal abelian subspace of p,. We extend 
a, to a maximal abelian subalgebra t of u. Let 6 denote the involutive auto- 
morphism T-HX>T—X(Tet,Xep,) ofu. If Het, 69H —HEp, and 
commutes elementwise with ay. Hence dt Ctandt=tNf-+a, Let j= t° 
Dp = 0° = Q4, the superscript c denoting complexification in ge. Then 
Dp ==) N p°. Extending the members of Ad(U) to g°, the Weyl group W(h) 
is the group of linear transformations of ) induced by those members of 
Ad(U) which leave h invariant, and the Weyl group W (Hp) is the group of 
linear transformations of ýy induced by those members of Adr(K) which 
leave hp invariant. Let I(§) and I (Ép) denote the corresponding algebras 
of invariant polynomial functions. 


PROPOSITION 7.4. The following properties of the symmetric space Q/K 
are equivalent: 


(i) Z(G/K) —D(G/K). 

(ii) The restriction from g to p maps I(g) onto I($). 
(ii) The restriction from u to pẹ maps I(t) onto I(p,). 
(iv) The restriction from h to hy maps I($) onto I (Bp). 


Proof. To prove the equivalence of (i) and (ii) we consider the canonical 
mapping A of S(g) onto D(@) which maps I(g) onto Z(G) (see [11], p. 
192). Let X, (1S iS n) be a basis of g such that X, (1Si=r) is a basis 
of p. Then, if gE G, fe C” (G), PES(g), %—=09/da, we have 

[A(P)f] (g) == [P (0n: + +n) f(g exp (21X1 +: +m&n)](0). 


Now suppose P€I(g) and let PE S(p) be determined by P—P € 8(g)t. 
Then PEI(p). On the other hand there exists a unique P’€ I (p) such that 
(see [14], Theorem 10) 


LACPE] r(g)) = [PG > +, (fom) (g exp(aiX1+- + + 2,X,))](0), 
and p(A(P’)) =u(A(P)). It follows that 
(3) A(P—P’) + \(P—P) —a(P —P’) € D(@)t, 


since » has kernel D,(@E) N D(G)f. Now suppose P is homogeneous of degree 
d>0. Then the same holds for P—P (0 has any degree) and P’ has 
degree d. But there exists an operator D,€ D(@) of order < d such that 
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\(P—P) —D,¢€ D(G)t. Thus, by (3) and the fact that A(S(p)) ND(G)E 
== 0 we obtain 
(4) degree (P— P’) < degree(P). 


The mapping u maps Z(G) onto D(@/K) .if and only if the mapping P> P” 
maps /(g) onto /(p), which, by (4), happens only if P— P maps I(g) onto 
I(p). This proves the equivalence of (i) and (ii). 

If the elements of Ad(@) and Ad(U) are extended to g°, a polynomial 
function on g° is invariant under Ad(@) if and only if it is invariant under 
Ad(T). Since the decompositions u =f + pẹ and g == X -+ p have a common 
complexification, namely g°==f° -+ p°, the equivalence of (ii) and (iii) is 
clear. 

Let 1(g°) and /(f°), respectively, denote the algebras of Ad(U)-invariant 
and Adr(K)-invariant polynomial functions on g° and p°. By a theorem of 
Chevalley ([15], p. 430) the restrictions from g° to h and from p° to by 
map I(g°) isomorphically onto I (b) and I(f°) isomorphically onto I (by). 
The restriction from g° to p° maps I(g°) into Z(p°) so the restriction from } 
to hy maps I (5) into I (Bp) and these maps are both onto if and only if one 
of them is. This proves the equivalence of (iii) and (iv) so Prop. 7.4 is 
proved. 


Terrorem 7.5. (i) Suppose g is a classical semisimple Ine algebra 
(real or complex). Then the restriction from h to hy maps I(h) onto I(h,). 


(ii) Part (i) does not hold? in general for the real forms of the excep- 
tional Lie algebras eg, Cr, es. 


Let A denote the set of nonzero roots of g° with respect to }. Let hy* 
denote the annihilator of p in the dual space $ of h, and if fis a function 
on h, let f denote its restriction to by. 

In the proof below we shall use the well known fact ([21], Theorem 3, 
[25], p. 108) that W(h,) consist of the restrictions to hy of those elements in 
W() which leave h, invariant. 


Proof of (i). It suffices to verify (i) in the case when g is a simple 
Lie algebra over R and does not have a complex structure. We shall use 
Cartan’s classification of such algebras, listed in [15], Ch. IX. Let 
D(a, ` *,@,) denote a diagonal matrix with diagonal elements a1: ` -, dp. 
Jf g is a normal real form of its complexification, then (i) is obvious. 


* The homomorphisms»: Z(G) > D(@/K) and #: Z(G) > D(@/K) are considered 
in F. A. Berezin [3]. On page 243 it is stated that » is onto and on page 248 it is 
stated that u is onto. Each of these statements is contradicted by Theorems 7.4 and 7. 5. 


592 8. HELGASON. 
These are the real forms AL, BDI (p—=g and p+ 1= q) and cr. We shall 
now verify (i) for the other real sinple Lie algebras. 
Type AU. Here 
bo — {D (ha «+, Pony hay’ © oy hte) WEC, Eu); 


(4) an l 
p = {D (hy: 7 +s ha limas’ -e shan): EC, È hu = 0}. 
1 


Let & (1&1 & 23n) be the linear form on § determined by 
(5) | ex (H) hy if H—=D(hy,- hen). 
Then the och system A is given by 

Am {+ (aa): 1Si<j<2n). 


The Weyl group W(b), acting on the dual of h, consists of all permutations 
of the e (1St2n). Hence I (6) consists of those polynomial functions 
on h which can be written as a symmetric function of the e. Now if s€ W(h) 
leaves fy invariant its action on 5 leaves h,* invariant so s(e -+ en) = &; + En 
Putting’ . E ae . 
f(E) = 4 (a (H) + em (H)) (Hei„isi=sn) 
80 fx f= Sun, one finds that W (hy), acting on Bp» consists of all permu- 
tations of the fı (1Sisn). Thus I(hp) consists of those polynomial func- 
tions on h, which can be written as a symmetric function of the fi (1 Stn). 
It is now clear that I(6)-—=I (bp). 


Type AM. Here we can take pq and 


= SC (Epu + Epu); 
p= (H = È u (Ewu + Byun) + Siin (Ba + Boiga) 
+ = Ba: hy, ty € C, Tr(H) —= 0}. 


In ha; this § is the image of (4) (p p q for 2n) under the automorphism 
X— AXA of 8l(p-+49,C), where A = I — j3 Cea Be Hereby, the 


linear forms (5) correspond to the linear forms 
puth) 1Si=Sp, 
a(H)=4 3w—h) p+iSi=R, 
us apt+1Sispt+¢ 
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. Thus ; 
A= {+ (4¢—¢) :1StjSpt+q}, 
and W(h), acting on the dual, consists of all permutations of the 4 
(1S1Sp+q). Since. 
byt = 2 Ce 
it is clear that «€ W (H) leaves hp invariant if and only if it permutes the & 
(2p+1SiSp-+q) and therefore also the a (1StS2p). The- restric- 
tions frp=& (1SiSp+q) satisfy 

` h= — bug (StSp),  &=0 (p+1StSp+ q). 

Therefore W (by), acting on the dual of by, consists of all the maps f,—> afou 
where a= +1, and o i ay permutation of (1, --,p}. Thus I (bp) is 
generated by the he polynomials È fe (1ISkSp) which are restrictions of the 
polynomials $ > et, 


Type BDI. Here we use the description in [29], p. 401. ‘The quadratic 
form bi eae to the m matrix 


NMO 4 | 
Ja—|I, 0 0 ) (=p) 
00 —Ig, 


has signature (p,q). The corresponding orthogonal group has Lie algebra 
g= {Le gl(p+g,R) 2 XI, + In = 0} 


and a Cartan involution of this Lie algebra is given by X > Jp,.XJp,q, inducing 
a Cartan decomposition g==f-+-p. Here we can take 


bp = {D (hu + +, Rp, — hu + *,—hħp 0,° + +, 0): EC} 
and if t= [4(q—p)], = 
eg ; 
j= {H = D hu (Bu — Eripsp) + È tu (Epson — Espn apta) | hyt E C}. 
Let 6 denote the linear form on 5 given by 


hy 1<j< 
6;(H) = d: i. J=P 


iu, ptiSjS[h(p+q)l. 
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Then 
= {+ (te): 1Si<jshhie+tn)]): 


Now we treat separately the cases p+ g == even, p + q= odd. 
Type DI, p+q=—2l. Here W(h), acting on 5, consists of all maps 
Š l 
&-> “eg, Where o is any permutation of {1,; --,J, «= + 1, and JJ a=1. 
i 
Hence I(h) is generates by e:e and the symmetric polynomials in 
6,7, Ear er. 
Now if p—gq, g is the normal form of g° so we may assume p < h 
p+isil. Then . € W(h) leaves by invariant if and only if it maps Coy 
and therefore also Ce, into itself. Putting fi==& (1SiSp) we see here: 


fore that W (bp) consists of all the maps fi> afou) Where o is any permutation 
of {1,---,p} and == +1. It is now clear that (Z(ĝ))-== Z (bp). 


Type BI, p+g=2!--1. Here W(h) consists of the maps &> eg), 
(o any permutation of {1,---,},q—=:+:1). That (I(b))-—J(hp) is seen 
in the same way as for DI. 


Type DH. Using again the description in [29], p. 406, g can be 
regarded as the Lie algebra of the group of linear transformations in 2} 
complex variables leaving invariant aa: 


Ziti H ' F Zakar (+ 221-1281), 
Ziem Het + Zorer + Brn He * + Zor2sr (+ 2grıZal-ı — Zaa), 


where k== [41], and the terms in the parentheses occur only if } is odd. 
The mapping Y->—'X is a Cartan involution of g, inducing a Cartan 
decomposition g =f -+ p of g. Here we can take (cf. [29], p. 408) 


bp = {D(In,- -t hr — hy: - nhe — Ia, ts 
; . — hr ha: + ehi (0, 0)):, h€- C}, 
b = {H = D (h: : > hr — Ri,‘ K Any hias’ “> 
han — hears’ . > shan, E ie Cc}, 
the terms in the parentheses occurring only if n is odd. If e is the linear 
form on § given by 
a(H) == hy (ists) 
then 
A= {+ (te): 1Si<jeh. 
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Here IF () consists of all the maps &— «ey, Where o is any permutation 
i 
of {1,---,2}, «=+ 1 and J[s—1. Hence /(h) is the same as for Type 
: k `> 1 
DI. Now = 5 C(e- eur) + (Cenn); if s€ W(h) leaves h, invariant, 
1 


it leaves H,* invariant and consequently s(e; -+ ej) = + (&- eux). Hence 
8(€;— enk) = + (G3 — enr). Tf we put fy d;—é, (LSjSk) we find 
therefore that the restriction of s to },, acting on Ép is of the form fj gfe 
where e;—=-+ 1 and o is a permutation of {1,---,}. It is also clear that 
each such o occurs in this manner; the «e; are also unrestricted since a change 
of sign of some f; is induced by a change of sign of an even number of 
e. The transformations fj «fo (y= +1, o arbitrary permutation of 
{1,: --:,%}) which are all different, the f; being linearly independent, exhaust 


k 
the group W(h,) ; the algebra I(§,) is generated by X f (n=1,  ',k). 
Also, if H E€ by = 


4(H)=h (1Sisk), 4u(H)=—hır (k+1515 2k), 


proving (I())- =I ($). 


Type CO. Here g=3p(p,g) and we suppose g—=T-+-p is the Cartan 
decomposition given in [15], p. 351. We assume pq. The complexification 
g°==8p(p-+q,C) has a Cartan subalgebra 


Y = {H = D (h, i -s huo — In,‘ i Ra): h€ C}. 
Let J denote the matrix in Sp(n,C) given by 


J =I + 2 (Eins — Epu) +2 (Eprat 2p+g+ a pai) } 
and let h denote the image of p under the automorphism X>JXJ of 
8p(p+q,C). We have 
BIETE D (thy st U) + È ti (Bro + Bosu) 
—È k; (Epron apsget + + Beggs prast) 


where 


w=} (h+ h), (ISiSp), wth, @9+1SjSp+ 9) 
kp (— ht ho), (LSiSp). 
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The intersection hM p° is . 
> C (Eira t Ban — Epas apa — Ep pron) 
which can serve as hy. Now consider the linear forms e/ on h defined by 
&«(H)=h (1StSp+q). 
Then if A’ denotes the set of nonzero roots of g° with respect to }’, 
Wm {E (of £ of), 1St<jSptqy E e (Sispa) 


The Weyl group W(b’) consists of all maps e — e'sa, where a= + 1 and 
o is an arbitrary permutation of {1,2,:--,n}. Consider the linear form e 
on h defined by &(JH’J") =e/(H’), H’ch’. Then 


u—k 1SiSp 
TE pPHISiS?p 
Ru; P+1Sisp+g 
= (+ (aty) 1St<jSptq;+2a(1StSp+Q)}, 


and W(h) consists of all MAPS &—> «lou, Where a= +1 and o arbitrary 
permutation of {1,2,---,n}. Also 


(6) By? =È Clet ue) + Car 


If se W(h) leaves by” invariant it is easily seen that s, acting on $, leaves 
each of the sums in (6) invariant. Consequently s(¢:— erp) = + (€;— Shp). 
If we put fy== &j— ëp (LS jp), the restriction of s to by, acting on By, 
is of the form fy>afoy (g—=+1, o any permutation of {1,---,p} and 
any such transformation of Bp arises from some se W(b). The f (1SjSp) 
being linearly independent, these transformations exhaust W(§,); the algebra 


I (bp) is generated by Spe (n=1,---,p) and 16) is generated by 
pia ı Ss 
ze (n=1,: 7 p+). Since 


ai thi, (p+1StS2p), 
0 (2p+1S5i1S5p+49), 


it is clear that I()- -=Z (ĝp). 
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. . ‘Proof of (ii). Consider first the noncompact symmetric space of type 
EIV, that is E,/F,. Here I (É) is generated by algebraically independent 
generators of degrees 2, 5, 6, 8, 9, 12 ([31], [5]). For this symmetric space 
the set 3, from §2 is the set of positive roots for. the Lie algebra of SU (8). 
(see [4], p. 422 or [1], p. 33). It follows that W(bhy) is the Weyl group of 
SU(3) s0.I (Bp) has generators tz, ts of degrées 2 and 3, respectively. However 
I (6) cannot contain any polynomial of degree 3 so I (H)- 41 (Ép). For the 
noncompact symmetric space of type E VII, that is H,/H,-T (T —1-torus) 
we have /(h) generated by algebraically independent generators of degrees 2, 
6, 8, 10, 12, 14, 18: Here the set Xo is the set of positive roots for the Lie 
algebra of Sp(3) (see [4], p. 423 or [1], p. 33). Thus W (Hp) is the Weyl 
group of Sp(3) and I (Bp) is generated by algebraically independent generators 
to, ta, t, of degrees 2, 4, 6 respectively. By the algebraic independence, 
wel (6). For the noncompact symmetric space of type EIX, that is 
E,/E,- SU(2), we have IQ) generated by algebraically independent generators 
of degrees 2, 8, 12, 14, 18, 20, 24, 30. The set X, is now the set of positive 
roots for the Lie algebra of F, so I (Bp) has algebraically independent generators 
of degrees 2, 6, 8,12. The one of degree 6 cannot belong to Iy. 

This concludes the proof of Theorem 7. 5. 

We observe now that in each of the three examples above the generators 
of I (by) which do not lie in (I6))- have degrees d— e where d and e are 
degrees of certain generators of I (§). This raises the question whether the 
elements in I (bp) are all obtained from rational invariants on § by restriction. 
We shall now prove that this is indeed the case. 


„ THEOREM 7.6. Let C(1(5)) and C(I(b,)) denote the quotient fields of 
I(h) and I (Ép), respectively. Then the restriction f — f from } to hy induces 


a mapping of C(I(5)) onto CI). 


Let U=-Int(u) as before and let @ denote the automorphism T + X 
>T—X (TELXEp,) of u. The corresponding automorphism of U will 
also be denoted by 6, and K, shall denote the group of fixed points of 9. Let 
A, denote the analytic subgroup exp(a,) of U and put Py —exp(b,). 


Lemma 7.7. A, equals its centralizer in Py. 


Proof. Suppose pe P, commutes elementwise with Ay. Let B’ denote 
the subgroup of U generated by p and A,, B the closure of B’ in U. Clearly, 
B consists of all products ap" (a€ Ay, n= integer). Now ab? (bE A+) 
and p=g? (QEP) so ap" == b?p” == bg”g"b == bg"d((bg")*). Since Pr 
— {ub (u>): u€ U} it follows that B’ C P; but P, being closed we have 
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BCP, The identity component B, of B contains some power of p, 80 Bo 
is a torus and B/B, is cyclic. As is well known this implies that there exists 
an element b€ B such that the sequence e,b, b*,- - - is dense in B. Select 
X E€ Pa such that b=-expX. Then the closure of the one-parameter subgroup 
{exp tX: t€ R} is a torus, contained in P,, but containing p and A,. But 
a, is maximal abelian in pẹ so this torus equals Ay, whence p€ Ay. 


Lumma 7.8. Let M’ denote the normalizer of a, in Kọ. Then M’A, 
ts the normalizer of ay in U. 


Proof. Suppose u€ U such that Ad(u)a Cay. Then u= kp, (k€ Ky 
p= exp X, X E p) so we conclude e4*(a,) C P, and therefore 


(sinh (ad X)) (H) — 0 for H € bp. 


Now ad X, acting on the complexification u° of u, is completely reducible and 
has purely imaginary eigenvalues. Let &,'  ',e„ be eigenvectors of ad X 
spanning u° and Ay," * ",A the corresponding eigenvalues. Let 


H— Las (H € by). 
Suppose &,' - ', €m are all the eigenvectors for which a,3£0. Since 
m 
0 = sinh (ad X) (H) -2 (sinh Ay) a;(H) e 


it follows that each Ay (1S jm) is an integral multiple of mt. Conse- 


quently 
EICH (77) =m H H € Ý 


so p? commutes elementwise with A,. By Lemma 7.7, p°==exp2H, for 
some HoE Qy. Put po =exp Ho. Then 8(pop™) = po™p == pop™ 80 p= kopo 
where ko€ Ky. Thus u = k expH, (VEK,) whence k’€ M’. 

Lemma 7.9. Let J denote the set of restrictions of the polynomials in 
I(ġ) to by. Let 8 (by) denote the symmetric algebra over Éy. Then 9 (By) 
is integral over J. 

Proof. Let pe 36) ‚ the symmetric algebra over ý. Then p satisfies 
the equation I] (x— p) —0 with leading coefficients 1 and coefficients in 

a. S ae W) a a 
I(h). This means that the ring 8(h) is integral over /(h). The restriction 


p->p gives a homomorphism of S (5) onto S (fp) mapping I (6) onto J. 
Hence the lemma. 
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Passing now to the proof of Theorem 7.6, suppose the quotient field 
C(J) were a proper subset of C(I(By)). Then there exists «€ Ip) ‚such 
that a¢ C(J). By Lemma 7.9, « is algebraic over C(J). Since /(h) is 
finitely generated, the homomorphic image J also has finitely many generators, 
say &,°° eén Let 


Pal) =a" + fa (jar? +--+ fa (E) (n= 2) 


be the polynomial with coefficients in the field C(J) =C (é, - -,&) of lowest 
degree having « as a zero and leading coefficient 1. Let f(&) denote the 
product of the denominators of the fi(£) and let q(é) denote the product of 
f(E) with the discriminant of the polynomial f(é)pa(z). Then g(£) is a 
polynomial function on hy, not identically 0. Select H, E a, such that 


(7) q(€) (Ay) +0, {exp tH,: tE R dense in A.} 


Consider the homomorphism A: p>p(H,) of J into C. The image of pa(x) 
under A is a polynomial with discriminant 40, which therefore has n dis- 
tinct roots, say a,°--,%€C. For each fixed t (1Stsin) we wish to 
extend A to a homomorphism %: C[é,,- > -,&,a«]—€ by putting 4(«) = a. 
To see that this is possible, suppose p(é,x) is a polynomial with coefficients 
in J=C[é,,---,é] which has « as a zero. Then pa(z) divides p(é, T), 
i.e. p(&2) = pa(x)g(é,c) and the coefficient of g(&,x) are rational expres- 
sions in é,’ ,&r whose denominators divide f(£). Since A(f(£)) #0 the 
image of p(é, v) under A has q% == œ; as a zero. Thus A, is well defined. Since 
S (by) is integral over J, and a fortiori over C[&,- * >, éa], there exists a 
homomorphism Ay: S(p) —>C extending A. Then there exists H,€ Hp such 
that Ay(p) = p(H;) for all pe S(p). In particular 


p( Hy) =p (H) — p (HE) for p € I (b), 


from which it follows easily that H., Hı, H. are all conjugate under W (Ñ). 
Since H, € a,, and since t is invariant under W(h), we obtain H., H€ tN Dy 
= Qy. Now select t, Ua€E U such that Ad(u)H, =H, (i= 1,2). Then 
wexptHgur = exp tH, (t—1,2) so by (7) u, and us belong to the nor- 
malizer of a, in U. Using Lemma 7.8 we have Ad(m)H,—=H, for some 
mei’. But the restrictions of Ad(If’) to a, constitute the Weyl group 
W(a,) although Kẹ may be larger than K (see [15], p. 244 and p. 273). 
Hence sH, == H, for some se W(a,). But then 


X, A,(a) =a (Hy) = a (H) = A (4) = Ga, 


which is a contradiction. 
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Remarks. (i) Theorem 7.6 had been proved independently by Harish- 
Chandra ‘(cf. also his proof in [15], p. 433 of the quoted result of Chevalley). 
(ii) (Added in proof). Since W(§p) is the group of linear transformations 
of hy induced by those elements of W(h) which leave Ņ, invariant, Theorem 
7.6 raises the following more general question: Let V be a vector space over 
C and G a finite group of linear transformations of V. Let W be a vector 
subspace of V and H the group of linear transformations of ,W induced by 
those members of G which leave W invariant. Does the restriction from V 
to W map the set of rational G-invariants on V onto the set of rational 
H-invariants on V onto the set of rational H-invariants on W? According 
to a communication from D. Mumford, the answer is affirmative. 
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COMPACTIFICATIONS AND SEMI-NORMAL SPACES. 


By ORRIN FRINK. 


The completely regular T, spaces or Tychonoff spaces are those with 
Hausdorff compactifications. They form a natural generalization of the metric 
spaces, they may be provided with a uniform structure, and may be charac- 
terized in terms of notions of proximity and separation [5]. However, no 
neat internal characterization of Tychonoff spaces seems to be known. In this 
note we provide such a characterization in terms of the notion of a normal 
base for the closed sets of a space. A normal base Z for the closed sets of a 
space X is a base which is a disjunctive ring of sets, disjoint members of 
which may be separated by disjoint complements of members of Z. The ring 
of all closed sets is a normal base if X is normal. We call a T, space having 
at least one normal base semi-normal. Unlike normality, the property of 
being semi-normal is hereditary and productive. 

Ina Tychonoff space X, the zero-sets of real continuous functions over X 
form a normal base. Hence every Tychonoff space is semi-normal. More 
generally, if Y is a Hausdorff compactification of X, and R is a lattice-ordered 
ring of real continuous functions over X which distinguishes points, and is 
such that the functions of R may be extended to continuous functions over 
Y, then the zero-sets of members of R form a normal base for X. Conversely 
it can be shown that if Z is a normal base, then the Wallman space w(Z) 
consisting of the Z-ultrafilters, is a Hausdorff compactification of X, It follows 
that every semi-normal space is Tychonoff. 

By choosing different normal bases Z for a non-compact semi-normal 
space X, different Hausdorff compactifications of X may be obtained in the 
form of Wallman spaces w(Z). It is natural to ask whether every Hausdorff 
compactification may be obtained in this way. I have not yet been able to 
_ answer this question. 

It is also natural to ask which real functions over a Tychonoff space X 
may be extended to continuous real functions over the compactification w(Z) 
associated with a normal base Z for X. We answer this question by showing 
that the functions which can be extended are those which are Z-uniformly 
continuous. We give also a similar criterion for the possibility of extending 
a continuous map of X into a compact Hausdorff space 7 to a continuous 
map of w(Z) into H. 
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Definitions. A base Z for the closed sets of a T, space X is said to be 
disjunctive if, given any closed set F and any point z not in F, there exists 
a closed set A of Z which contains z and is disjoint from F. This is similar 
to the disjunction property of Wallman. 

A family of sets is called a ring of sets if it contains all finite unions and 
intersections of its members. Every ring of sets is a lattice. 

A base Z for the closed sets of a T, space is called a normal base if it is 
a disjunctive ring of closed sets such that any two disjoint members A and B 
of Z are subsets respectively of disjoint complements C’ and D’ of members 
C and D of Z; that is, ACC’, BCD’, and C N D= Ø. 

Members of a normal base Z will be called Z-sets, and their complements 
Z-complements. The Z-complements form a base for the open sets of the 
space. 

A proper subset of a normal base Z is called a Z-filter if it is closed 
under finite intersection and contains every superset in Z of each of its 
members. No Z-filter contains the empty set @. 

A Z-ultrafilter is a maximal Z-filter. It follows from Zorn’s lemma that 
every Z-filter is contained in at least one Z-ultrafilter. 

A T, space X is called semi-normal if there exists at least one normal 
base Z for the closed sets of X. 


THEOREM 1. A T, space is completely regular tf and only if il is 
semi-normal. 


Proof. I£ the space X is completely regular, it is well known, and easily 
verified, that the family Z of all zero-sets of X, that is, of sets f”(0) where 
continuous real functions f(z) defined over X take the value zero, is a dis- 
junctive base for the closed sets of X. It is shown in the book “Rings of 
Continuous Functions” by L. Gillman and M. Jerison [3], that Z is a ring 
of sets, and that disjoint Z-sets may be separated by disjoint Z-complements. 
Hence Z is a normal base for X. It follows that every completely regular 
Tı space is semi-normal. 

Conversely, if X is a semi-normal space with normal base Z, we wish 
to show that X is homeomorphic to a dense subset of a certain compact 
Hausdorff space w(Z), namely the Wallman space consisting of Z-ultrafilters. 
It will follow that X is T, and completely regular. 

We define a topology in the set w(Z) consisting of all Zau in 
the usual way, by taking as a base for the closed sets of w(Z) the family of 
all sets A*, where A* is the set of all Z-ultrafilters having A as a member, 
A being an arbitrary member of Z. This is equivalent to taking as a base 
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for the open sets of w(Z) the family of all sets U* consisting of all-Z-ultra- 
filters having at least one subset of U as a member, U being an arbitrary 
Z-complement. 

The space X is imbedded in the space w(Z) by the imbedding map, which 
` sends a point z of X into the Z-ultrafilter consisting of all Z-sets which con- 
tain x. This imbedding maps X into a dense subset of w(Z), since every 
non-empty basie open set of type U* contains the image of at least one point 
of X. That the imbedding map is one-to-one follows from the fact that the 
base Z is disjunctive. That the imbedding map is a homeomorphism follows 
from the correspondence between the basic open sets U and U*. 

That the space w(Z) is compact may be seen as follows. Corresponding 
‘to any family having the finite intersection property, and consisting of .basic 
closed sets of type A* in w(Z), is the family consisting of the corresponding 
Z-sets A in X, which has also the finite intersection property. The extension 
of this family of Z-sets to be maximal is a Z-ultrafilter, which is seen’ to lie 
in every basic set A* of the original family. Hence this family has a non- 
empty intersection. Since the sets A* form a base for the’ closed set of 
w(Z), it follows that w(Z) is compact. 

Finally it may be seen that w(Z) is a Hausdorff space. Any two distinct 
Z-ultrafilters Q@ and 8 must contain disjoint Z-sets A and B. Since Zis a 
normal base, A and B must lie respectively in disjoint open Z-complements, 
U and V. Hence the disjoint open sets U* and V* in w(Z) are open sets 
containing @ and 8, and the space has the Hausdorff separation property. 

The foregoing proof that w(Z) is a Hausdorff compactification of X is 
similar to Wallman’s original proof for the case where X is normal and Z is 
the family of all closed sets of X [9]. It is similar also to Kelley’s proof of 
Wallman’s theorem [4]. It uses some of the terminology of Gillman and 

‘Jerison, who show in [3] that if Z is the family of all zero-sets of real cor- 

tinuous functions over a Tychonoff space X, then w(Z) is homeomorphie to 
‘the’ Stone-Cech compactification 8X. We have modified the Gillman-Jerison 
procedure by requiring only that the normal base Z have those properties of 
the family of zero-sets which are needed to carry through the proof that w 4 ) 
is & Hausdorff SERDESUN ALIEN, of X. 


Continuous extensions, It is natural to ask what bounded continuous- 

‚Teal functions on a space X may be extended to functions which are continuous 
on & particular Hausdorff compactification of X, such as w(Z). Many results 

of this general nature are well known. For example, if X is a subspace of a 
, metric space F, the real functions on X that may be extended to continuous 
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functions on Y are those that are uniformly continuous relative to the metric 
of. Y. There are similar theorems for uniform spaces. We define here a 
related condition called Z-uniform continuity for spaces with a normal base Z. 


Definition. A real function f(x) defined over a semi-normal space X 
with normal base Z is said to be Z-uniformly continuous if for every positive 
epsilon there exists a finite open cover of X by Z-complements, ón each of 
which the oscillation of f(z) is less than epsilon. 


THEOREM 2. A real function f(x) defined over a semi-normal space X 
with normal base Z can be extended to a real continuous function over the - 
compactification w(Z) tf and only if f(x). is Z-untformly continuous. 


‘Proof. The condition is necessary, for suppose f(y) is a continuous real 
function defined over the compact space w(Z). Given a positive epsilon, 
‘we may cover w(Z) by a finite number of basic open sets U,*, on each of 
which the oscillation of f(y) is less than epsilon. The corresponding sets U, 
of X are Z-complements, they cover X, and on each of them the oscillation 
of the restriction f(x) of f(y) to X is less than epsilon. Hence every such 
function f(z) defined over X and having a continuous extension to w(Z) is 
Z-uniformly continuous. 

Conversely, suppose the real function f(x) is Z-uniformly continuous on 
a semi-normal space X with normal base Z. We may assume without loss of 
generality that Z contains all singletons {z} of X, since if Z is extended to 
the smallest ring of. sets containing Z and all singletons, a new normal base 
will be obtained leading to the same compactification, and with the same 
determination of Z-uniform continuity. 

We define a function g(y) over w(Z) which is intended to be a ‘con- 
tinuous extension of f(x), as follows. Each point y of w(Z) is a Z-ultra- 
filter, and therefore a family of sets of Z which is dually directed by the subset 
relation. From every member n of the family of sets y we select a point 2, 
of X which is a member of n. This is possible by the axiom of choice, since 
no member of y is empty. Consider the net {f(z2,)}, with indices n ordered 
by the superset relation. Since f(z) is Z-uniformly continuous, it follows 
that the net {f(a,)} satisfies the Cauchy convergence criterion for nets of 
.real numbers. Here this net converges to a real number which we call g(y). 
1f y is the image under the imbedding map of a point æ of X, then y as a 
directed set has the last element {x}, and the net converges to f(z) =g(y). 
Hence g is an extension of f. l 

We now show that g(y) is continuous. Given e > 0, let the family {Uj} 
„be a finite open’ cover of X ‚by Z-complements, on each member of which the 
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oscillation of f(x) is less than e/3. The corresponding family {U;*} is an 
open cover of w(Z). It follows that the oscillation of g(y) .on each set U;* 
of the cover is less than e. For let y and y be any two Z-ultrafilters of U,*. 
Then by definition of g(y) there exist elements m and n of y and 4/ respectively, 
each a subset of Uy, such that |f(tn)—g(y)| <e/3 and fan) —9(y’)| 
<e/3. Hence | g(y) —g(y’)| <s and the function g(y) is continuous, 
This completes the proof. 

Theorem 2 can be generalized to give a necessary and sufficient condition 
that a continuous map of a semi-normal space X with normal base Z into a 
compact Hausdorff space H can be extended to a continuous map of the 
compactification w(Z) into H. We say that a map of X into H is uniformly 
continuous relative to Z and H if corresponding to every finite open cover F 
of H there exists a finite open cover G of X by sets which are Z-complements, 
such that each member of @ is sent into a subset of a member of F by the map. 

A proof similar to that of Theorem 2 will then show that a map of X 
into H can be extended to a continuous map of w(Z) into H if and only if 
the map is uniformly continuous relative to Z and H. 

Theorem 2 suggests that the concept of a normal base Z for a Tychonoff 
space X is similar to that of a uniformity for X. It suggests also a modifica- 
tion of the Cech homology theory for a space with normal base Z, in which 
the finite open covers are restricted to those whose members are Z-complements. 


- Conclusion. It is clear that different compactifications w(Z) of Wallman 
type may be obtained for a non-compact Tychonoff space X by choosing 
different normal bases Z for X. The question remains open whether every 
Hausdorff compactification Y of X can be obtained in this way, in the sense 
that Y is homeomorphic to some Wallman space w(Z). Every compactifica- 
tion Y of X determines a normal base for X consisting of tlie zero-sets of the 
ring of those continuous real functions defined over X which may be extended 
to continuous functions over Y. However, examples show that the Wallman 
space w(Z) determined by the zero-sets of functions continuously extendable 
to Y may not be homeomorphic to Y. 

Consider the one-point compactification N* of the countable discrete 
space N. It may easily be seen that every subset of N is the zero-set of some 
real function continuously extendable to N*. Hence the Wallman space deter- 
mined by these zero-sets is the Stone-Gech space BN, which is certainly not 
homeomorphie to N*. This example is due to Robert M. Brooks of the 
University of Minnesota. 

However, Brooks has shown that the eee Hausdorff compactifica- 
tion of a locally compact Hausdorff space X may always be obtained as a 
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Wallman space w(Z), where the normal base Z consists of the zero-sets of those 
continuous real functions on X which are constant on some complement of a 
compact set. The results of Brooks have not yet been published. 

Every Hausdorff compactification Y of a semi-normal space X may be 
represented as the structure space of maximal ideals of the ring Æ of those 
real functions in X which are continuously extendable to Y; it may also be 
represented as a structure space of those subrings of R which are lattice ordered 
and which distinguish points of Y. It is conceivable, but by no means evident, 
that Y may be always isomorphic to the Wallman space w(Z) determined by 
the normal base Z consisting of the zero-sets of some subring of R. 

Tt should be noted that a normal base Z for a semi-normal space does not 
necessarily consist of zero-sets. Given a normal base Z of zero-sets of a space 
X, it often happens that a subfamily of Z of lower cardinality than Z exists 
which leads to the same Wallman compactification as Z. 

Normality is neither hereditary nor productive; subspaces and cartesian 
products of normal spaces need not be normal. However, the property of being 
semi-normal is both hereditary and productive since it is equivalent to being T, 
and completely regular, and these properties are hereditary and productive. 
It would be desirable to have simple direct proofs that subspaces and cartesian 
products of spaces with a normal base have normal bases. 


THE PENNSYLVANIA STATE UNIVERSITY, 
UNIVERSITY PARK, Pa. 
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FINITE GROUPS HAVING A FAITHFUL REPRESENTATION 
-OF DEGREE LESS THAN (2p + 1)/3. 


By Davip L. WINTER. 


1. Introduction. The principal result of this paper is the 


Marn Tuxorem. Let p be a prime and let G be a finite group of order 
pig’ where (p,g’)=1. If G has a faithful representation 3 of degres-n 
over the complex number field, and if n< (2p-+1)/8, then one Of thé 
following holds: 


(A) The p-Sylow subgroup of G is an abelian normal ee of G. 


(B) p>? G= HM is the product of normal subgroups H and M of 
G where (i) G/H =LF (2, p). (ii) H contains an abelian normal p-Sylow 
subgroup P, of order pe". (ii) M/B = LF (2, p) where B is the normal sub- 
group of M consisting of all p-regular elements of M which are commutative 
with an arbitrary fixed element of M of order p. (iv) HNM—B. (v) The 
centralizer of P, in G is Py) XM. (vi) If P, is an arbitrary p-Sylow sub- 
group of M, then the centralizer of P, in Gis P, XH. Further, if 3 is irre- 
ducible or if n= (p + 1)/2, then H =Z, the center of G. . 


(C) pam? G/Z = LF (2,7) or A, 

(D) p=5. G/Z=LF(2,5) or Au. 

(E) p—3. Q/Z=LF(2,3), 8, or As. 
_ A first step here will be to prove 


THEOREM I. Let p be a prime and let .@ be a finite group which has 
a faithful representation of degree n= (p—1)/2 over the complex number 
field. Then etther G has an abelian normal p-Sylow subgroup or the factor 
group, G/Z, of G modulo the center of G ts isomorphic to LF (2, p). 


~ These theorems have already been proved in the case when the order of G 
is divisible by the prime p to the first power only: Theorem I by R. Brauer 


Received January 7, 1964. 
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([2], Theorem 4) and the Main Theorem by H. F. Tuan [8]. If in the 
statement of Theorem I n = (p—1)/2 is replaced by n < (p—1)/2, W. Feit 
and J. G. Thompson [5] have shown that the group G has an abelian normal 
p-Sylow subgroup. This result as well as the methods of [5] are used in 
the proof of Theorem 1. The proof of the Main Theorem is made to depend 
on a special case of the following result due to W. Feit [4]: 


(1A) Let Q be a group of order g which has a faithful representation 
of degree n over the complex numbers. Let g==gıh where (gu, h) =1 and 
p>n-+1 for every prime p dividing h. Then G contains a normal abelian 
subgroup K of order h or h/p for some prime p. 


The-author would like to acknowledge the guidance of his thesis advisor, 
Professor H. S. Leonard, Jr., during this research work. 


2. Notation and preliminary results, All groups considered in this 
paper are of finite order and all group representations are representations by 
linear transformations over the complex number fiéld. 

H < G means that H is a normal subgroup of G. Z(H) is the center 
of the subgroup H and we shall write Z=Z(@). | G | denotes the order of G. 
If S is an arbitrary subset of G, C(S) and N(S) denote, respectively, the 
centralizer of S in GŒ and the normalizer of 8 in G. C(y) is the centralizer 
of the element yin G. If S and T are subsets of the group G, S—T denotes 
the set of all elements in S which are not members of T. 

The following short results are used frequently in later sections. 


(2.1) Let p bea prime. If the finite group G has a faithful represen- 
tation of degree n < (p—1) over the complex number field and if G contains 
a normal p-complement, then G has a normal p-Sylow subgroup. 


Proof. Let | @|=ptg’ with (p,g’) 1. By assumption G contains a 
normal subgroup H of order | H | =g’. Let g be a prime divisor of g’ and 
let Q be a Sylow g-subgroup of H. Every conjugate of Q relative to G is a 
conjugate of Q relative to H; hence, (G: N(Q)) = (H: HN N(Q)). The 
latter ‘is relatively prime to p and therefore p*||N(Q)|. Thus if Pisa 
Sylow p-subgroup of G, Q may be chosen so that PC N(Q). Then PQ isa 
group with Q < PQ and PQ is solvable. N. Ito [6] has proved that a finite 
solvable group having a faithful representation of degree n < (p— 1) over 
the-complex number field contains a normal p-Sylow subgroup. Therefore 
P<PQ.and QCN(P). Since q was an arbitrary prime dividing g’, we 
see that g’ | | N(P)| which implies N (P) — G 
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(2.2) Let p be a prime and let G be a finite group which has a faithful 
representation 3 of degree n over the complex number field. If n< p, then 
every p-Sylow subgroup of G ts abeltan. 


For, let P be a p-Sylow subgroup of G. Then 3| P is a faithful repre- 
sentation of P. Since n < p and since the degree of each irreducible constituent 
of a | P is a factor of | P |, each of these degrees must be 1. Therefore g | P, 
considered as a matrix representation of P, in completely reduced form is an 
isomorphism of P onto a group of diagonal matrices. Hence P is abelian. 

The result of Feit and Thompson [5] is easily generalized in the following 
way. 

(2.3) Let p be a prime and let G be a finite group which has a faithful 
representation 3 over the complex number field all of whose irreducible con- 
stituents are of degree less than (p—-1)/2. Then G has an abelian normal 
p-Sylow subgroup. 


Proof. Let D., Da, D: be the irreducible constituents of 3 and 
consider 3 to be a matrix representation of G. Then for all r€ @ the matrices 
[a(z)], in completely reduced form appear as 


[2ı(2)] 0 
[D2(z) ] 
[3(2)] = i 


0 Da) 


where the 0’s indicate that the remaining entries are all zeros. Let K., 
K,,: - -,K; be the kernels of the representations Da, Da,- - +, Di, respectively. 
Then 2; is a faithful representation of the factor group G/K;, of degree less 
than (p —1)/2 fori—1,2,---,¢. By the result of [5] G/K;, has an abelian 
normal p-Sylow subgroup for allt. Now let z and y be any two elements of 
G of p-power order. Then the cosets Kis and Ky are elements of G/K;, of 
p-power order. Hence the matrices [D,(z)] and [D,(y)] commute for 
i= 1,2,---,t. It follows by block multiplication of matrices that [7 (=) ] 
and [3(y)] commute. Since z and y were arbitrary elements of @ of p-power 
order, it follows that the set of all elements of @ of p-power forms an abelian 
group, hence an abelian normal p-Sylow subgroup of G. 


(2.4) Let G be a finite group which has a faithful representation 3 


over the complex number field and let H be a subgroup of G. If a| His an 
irreducible representation of H, then Z(H) CZ. 
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For, 3 may be considered to be a representation of @ by matrices. If 
a| H is irreducible, then from Schur’s lemma each member of Z(H) is 
represented by a scalar multiple of the identity matrix. Hence, the matrices 
corresponding to Z(H) are commutative with all the matrices corresponding 
to elements of G. Since 3 is one-one, this implies that Z(H) C Z. 

The following result is an immediate consequence of Theorem 7, page 
173, of [9]. 


(2.5) Let p be a prime and let G be a finite group which has an 
abelian p-Sylow subgroup. If Z=Z(G) and p||Z|, then G@ contains a 
proper normal subgroup whose index in G is a power of p. 


(2.6) Let p be a prime and let P be a p-Sylow subgroup of the finite 
group G. If K is a subgroup of G with K CZ and tf G/K has a normal 
p-Sylow subgroup, then P 4G. 


For, if @/K has a normal p-Sylow subgroup, then KP/K is this Sylow 
subgroup and KP<jG. Since KC Z, PKP. Hence, PG. 


3. Proof of Theorem I. The following result was proved in [6] although 
it was not explicitly stated there. 


(3A) Let p be a prime. If the finite group G has a fatthful repre- 
sentation of degree n < (p—1) over the complex number field, then p? does 
not divide the order of G if the following conditions hold: (i) The center 
Z of G is the unique maximal normal subgroup of G and pf|Z|; (ii) Let P 
be a p-Sylow subgroup of G. Let N be the set of all elements in the normalizer 
N(P) of P which are not in the center of G but whose centralizers do contain 
elements of P other than the identity. Then for ze G, N NaNe? not empty 
implies ze N(P). 


Throughout the remainder of this section it will be assumed that @ is 
a counter-example to Theorem I of minimal order. This implies, in particular, 
that Theorem I is true for every proper subgroup of G and that p>3. By 
means of a series of steps similar to those in [5] it will be shown that G 
satisfies all the hypotheses of (3A) and, hence, that p’ f |G]. Since Theorem 
I has been proved in the case when the order of @ is divisible by p to the 
first power only, this will yield a contradiction which suffices to complete 
the proof. 

P will always denote a fixed p-Sylow subgroup of G. By (2.2) 


(3.1) P is an abelian group. 


10 
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(8.2) , The-inder of a proper normal subgroup of G cannot be a power 
of p. ae oa ee Eh 
Let H be a counter-example to (3.2). Assume first that H has a normal 
p-Sylow group Py (the case Pg= {1} is included here). Since H< G, 
Pa < G and therefore O (Pa) << G. Since P is abelian, PC O (Pya). Hence, 
C(Py) cannot have a normal p-Sylow subgroup, since the same would then 
be true of @. Since the faithful representation 3 of @ has degree (p—1)/2, 
it follows from (2.3) that 3 | C (Px) is an irreducible representation of O (Pr). 
By (2.4) Pa CZ. By a theorem due to W. Burnside H contains a normal 
p-complement which is necessarily a normal p-complement of G. (2.1) now 
yields that P < G, contrary to assumption. Therefore, H does not have a 
normal p-Sylow subgroup. l l 

The minimal nature of @ now yields that H/Z(H) = LF (2, p). By 
(2.3) a| H must be irreducible and hence by (2.4), Z(H) CZ. H/Z(H) 
is thus a normal subgroup of G/Z(H) whose index in G/Z(H) is a positive 
power of p. M. Suzuki ([7], Lemma’ 2) has shown that the index.of the 
group of inner automorphisms of LF (2, p) in the group of all automorphisms 
of LF(2,p) is 2. It follows easily from this result that, if L is a subgroup 
of an arbitrary finite group with L= LF (2, p), then the index of C(L)L in 
N(L) is 1 or 2. Since (G: H) is a positive power of p, it may be concluded 
that if R is the normal subgroup of G, containing Z(H), such that R/Z (H) 
is the centralizer of H/Z(H) in G/Z(H), then (R/Z(H))(H/Z(H)) == @/Z(H).. 
Since H/Z(H) = LF(2,p) is a simple group, R/Z(H) N H/Z(H) = {1} and 
hence | R/Z(H)| = (@/Z(H): H/Z(H)) which is a positive power of p. 
Therefore |R|—=p*|Z(H)| for some k>0. Since Z(H) CZ, if Pr is 
a p-Sylow subgroup of R, R=PrZ(H). But Z(H)CN(Pr) so that 
Pr < PrZ(H) =R. Since RIG, Pe <1@ and O(Pr) < G. P being abelian 
implies that P C O (Pr) and, thus, O (Pr) cannot have a normal p-Sylow 
subgroup or the same would be true of G. (2.3) yields that 3.| C(Pr) is 
irreducible and (2.4) that PR CZ. Therefore R==PpZ(H) CZ. But 
@/R=RH/R=H/ENH—=H/Z(H) = LF (2, p) is a simple group. Hence, 
R is a maximal normal subgroup of G. Therefore, R = Z and G/Z = LF(2, = 
a ee . This oom plakes the proof. of (3.2). 


(3.8) Z is the unique mazimal normal subgroup of G. PIZI 


Let H be-a proper normal subgroup of G. Then PH is a group and by 
, (8.2) PH AG. Suppose that PH does not have a normal p-Sylow subgroup. 
Then by the induction hypothesis PH/Z (PH) = LF (2, p). Since the order 
of LF (2, p) is divisible by p to the first power only, |Z(PH)| is divisible by 
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po! where p° is the highest power of p dividing |@|. But a = 2 since Theorem 
I has been proved in the case that | G | is divisible by p to the first power only. 
Therefore, p+ = p. (2.3) and (2.4) yield as before that Z(PH) GZ and 
hence p||Z|. (2.5) now leads to a contradiction of (3.2). Therefore, 
PH and, consequently, H contain normal .p-Sylow subgroups. If Px is the 
p-Sylow subgroup of H, then Py < G. Since P is abelian, PC C (Pa). < G. 
P is not a normal subgroup of C(Px) for otherwise it would follow that 
P<jG. Application of (2.3) and (2.4) yield that Py CZ. Hence, Pg == {1} 
for if not (2.5) leads to. a contradiction of (3.2). - It has thus been shown 
that, if H is a proper normal subgroup of G, then p{|H| and that P < PH. 
_ Sine PNH=({1}, PHP XH and therefore, PCC(H). Since 
C(H) < G, we must have C(H) == G. Therefore, H CZ and (3.3) follows. 


(3.4) PO aPrt— {1}, unless zeN(P). 


l For, let P,=PNzPr" be an intersection of distinct p-Sylow subgroups 
of G. Then both P and zPz are contained in C(P,) so that O(P.) does 
not have a normal p-Sylow subgroup. By (2.3) 3|C(P ) is irreducible. 
Hence, (2.4) yields that P, CZ and (3.3) that P, = {1}. 

Let N be the set of all elements of N (P) —Z whose centralizers contain 
elements of P other than the identity. 


(3.5) NNaNr!s£s implies zeN(P). 


For, if yE N NaNrt, then both y and sys are members of N. By 
the definition of N there exist P, 4 {1} and P,£ {1}, subgroups of P, such 
that P,CC(y) and P,CO(2yz), or such that both.P, and zP,r* are 
contained in C(y). Since y¢ Z, (2.4) implies that a | O (y) is reducible and 
(2.3) that C(y) has a normal p-Sylow subgroup. Since P, and xP,a are 
both contained in this, Sylow subgroup, (3.4) implies that they are both con- 
tained in P. Hence by (3.4) zeN(P).. 


(3.3) and (3.5) show that G satisfies the hypotheses of (3A). As 
mentioned above this is sufficient to complete the proof of Theorem I. 


4. Proof of the Main Theorem when p> 7. The following assump- 
tions are made throughout the next four lemmas. 


pisa prime with p>. G tsa finite group of order p*g’ with (p, g) =i 
which has a faithful representation a of degree n< (2p+1)/8 over the 
complex number field. G contains a normal subgroup P, of order p> but 
G does not contain a normal p-Sylow subgroup. 
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(4.1) If P, is contained in the center Z of G, then G is of the form 
G=P,xXM, where M/B&LF(2,p), B being the normal subgroup of M 
consisting of all p-regular elements of M which are commutative with an 
arbitrary fived element of M or order p. 


Proof. Let G be a counter-example to (4.1) of minimal order. Then 
necessarily a@=22, for if p?{|@|, Tuan’s Main Theorem yields a contra- 
diction. Consequently, | P,|=">=p and by (2.5) @ contains a proper 
normal subgroup H whose index in @ is a power of p. Suppose H has a 
normal p-Sylow subgroup Py. Since H G, Pu < G and O(Pa) <JG. By 
(2.2) every p-Sylow subgroup of @ is abelian so that p*||C(Py)|. There- 
fore, if C(Px) had a normal p-Sylow subgroup, the same would be true 
of G. Thus, C(Py) does not have a normal p-Sylow subgroup. Let 
H,—=(C(Pa)NH. H, contains all p-regular elements of C(Pq) since H 
contains all p-regular elements of G. Py is a p-Sylow subgroup of H, con- 
tained in the center of H, By Burnside’s theorem H, contains a normal 
p-complement which is necessarily a normal p-complement of C (Pa). There- 
fore, by (2.1) C (Pa) has a normal p-Sylow subgroup which is a contradiction. 
Hence, H does not have a normal p-Sylow subgroup. Let |H |= pg’. Then 
since G= P,H, | Po N H |=| Po|: |H |/| G| = ppg’ /pg — pt. There- 
fore, P, = Po N H is a p-Subgroup of H of order p> contained in the center 
of H. The minimal nature of G yields that H == P, X M where M is as 
described in (4.1). Since P, N M = {1}, G= P, X M. 


(4.2) If a is irreducible, then G/Z = LF (2, p) and P, CZ. 


Proof. Since Po < G, C(Po) < G and since every p-Sylow subgroup of 
@ is abelian, p | |C(P,)|. Hence, O(P.) cannot have a normal p-Sylow 
subgroup or else the same would be true of G. Suppose that a | O(P.) is 
reducible. Then, by a theorem due to A. H. Clifford [3], all irređucible 
constituents of 3 | C(P,) must have the same degree. Hence, all irreducible 
constituents of 3 | O(P.) have degree less than (p—1)/2. (2.3) now yields 
that C (Pa) has a normal p-Sylow subgroup which is a contradiction. There- 
fore, 3 | C (Po) is an irreducible representation of C(P,). It follows from 
(2.4) that CZ. From (4.1) G= P, X M, where M/B = LF (2, p). Now 
3 | M is irreducible because of the theorem about irreducible representations 
of direct products. Consequently, Tuan’s Main Theorem yields that B == Z(M), 
the center of M. Since Ge=P, X M, Z= PZ (M), and 


@/Z=P,M/PZ(M) = M/Z(M) = LF (2, p). 
(4.3) If the degree n of 3 is (p =1)/2, then G/Z = LF (2, p). 
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Proof. If n—(p—1)/2, the result follows from Theorem I and if 3 
is irreducible, (4.3) follows from (4.2). It may therefore be assumed that 3 
has degree n == (p+ 1)/2 and is reducible. Since G does not have a normal 
p-Sylow subgroup, we conclude from (2.3) that 3 is the sum of two irreducible 
constituents, D of degree 1 and E of degree (p—1)/2. Thus, in completely 
reduced matrix form 3 appears as 


[D(e)] 0---0 
0 

[a(z) ] org [é(z)] 
0 


It is clear, using Schur’s lemma, that the center Z of @ is the set of 
all x such that [E(z)] is a scalar matrix. Hence if K is the kernel of E, 
then € is a faithful representation of G/K and KC Z. G/K does not have 
a normal p-Sylow subgroup because otherwise G would have a normal p-Sylow 
subgroup by (2.6). It follows from Theorem I that if L/K is the center of 
G/K, then (G/K)/(L/K) = G/L = LF(2,p). But L is the set of all se G 
for which [€(z)] is a scalar matrix. Hence L—Z and G/Z = LF(2,p). 


(4.4) G=HM with HAG, M<IG where (i) G/H = LF (2, p). 
(ii) Po is the normal p-Sylow subgroup of H. (iii) M/B=LF(2,p) where 
B is the set of all p-regular elements of M which are commutative with an 
arbitrary fixed element of M of order p. (iv) HOM =BG. (v) C(Po) 
=P)XM. (vi) If Pı is an arbitrary p-Sylow subgroup of M, then C(P:) 
P, X H. 


Proof. Suppose that 3 is irreducible. Then by (4.2) and (4.1) 
G/Z = LF (2p), P CZ and G=P,X M. Here M/B=LF(?,p) where B 
is defined in the statement (4.1). But since by the theorem on irreducible 
representations of direct products 3 | M is irreducible, Tuan’s Main Theorem 
yields that B =Z (M). Since G= P, X M, Z =P., (M). Set H =P, (M). 
Then G == HM and all conclusions of (4.4) follow. Hence it may be assumed 
that 3 is reducible. 

Since @ does not have a normal p-Sylow subgroup, it follows from (2.3) 
that 3 has an irreducible constituent, say 3, of degree > (p—1)/2. Let 3 
be the sum of the remaining constituents so that 3=3ı ®3.. Consider the 
kernels K, and Ka of 3, and gz. 4, and ĝa are faithful representations of 
G/K, and G/K., respectively. Since n < (2p+1)/3, the degree of each 
irreducible constituent of 4, must be < (p—1)/2 so that by (2.3) G/K, 
has a normal abelian p-Sylow subgroup. Further, G/K, does not have a 
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normal p-Sylow subgroup for otherwise an argument like that in ‘the proof 
of (2.3) would lead to the contradiction that G has a normal p-Sylow sub- 
group.. Since a is faithful, K,K,— {1} and hence 4, | K, is a faithful 
representation of K, all of whose irreducible constituents are of degree 
<(p—1)/2. By (2.3) K, has a normal p-Sylow subgroup Pı Since 
Eig G,- P, <Q. P, is therefore contained in the intersection Q.of all 
p-Sylow subgroups of G. Since 9G, |Q|<p. But P,C@ and has 
order p*, Hence, Q == P, and PC Py. Let P be a p-Sylow subgroup of G. 
Then P, and P, are both contained in P and P, == P N K, =P, N Kı. Now 
PK,/K, is a p-Sylow subgroup of G/K, and is not normal in @/K,, but 
P,K,/K, is a normal subgroup of G/K,. Let the order of PK,/K, be p°. 
Then | PoK1/Ki|=|Po/KiN Po | = | P/E: O P |= ped. Since 4: is 
irreducible, this shows that the result of (4.2) may be applied to the group 
G/K,. We conclude that if H is the normal subgroup of G such that H/E, 
is the center of G/K,, then G/H = (G/K,)/(H/K,) = LF (2, p). 

Since the order of LF(2,p) is divisible by p to the first power only, 
a p-Srlow subgroup of H must have order p**. Because of the fact that 
PH <G and H is a maximal normal subgroup of @, P.H =H. Heng: 
P,CH and P, is the normal p-Sylow subgroup of H. 

Since C (Po) does not have a normal p-Sylow uhr (4 1) yields 
that C (Po) =P, X M where M/B = LF(2,p). O(P.) < G implies that for 
any zE G, cMr C O(P.) and Mar" <C (Po) since M <C (Po). MN eMe 
< C(P,) and contains all p-regular elements of O(P,). Hence B is properly 
contained inMNzHUr" and since B is a maximal normal subgroup of M, 
we must have M N zM“ == M. Thus M — zMr and M < G. The definition 
of B implies that B is the normal subgroup of M consisting of all p-regular 
elements of M which are commutative with all elements of M of order p: 
Hence B is a characteristic subgroup of M, so that B 3 G. Recalling H <j G, 
we have HB < G which implies that BC H, H being a maximal normal 
subgroup of G. Therefore BCHNM<QM. HOAM=—WM is impossible 
since H has a normal p-Sylow subgroup and M does not. Since B-is a 
maximal normal subgroup of M, we conclude that H N M =B: Hence, 
HM/H = M/H N M = M/B = LF (R, p) and since G/H = LF (2, p), we con- 
clude that G— HM. Further, (H/B) (M/B) = (HABI RUE) and there- 
fore H/B centralizes M/B. 

From these remarks it follows easily that if P, is'an arbitrary p-Sylow 
subgroup of M, then P,H == P, X H C O(P). On the other hand, an element 
of O(P.) has the form hm with he H, me M since G= HM. "But for such 
an element m€C(P:)NM=P,XBCP,XH. Therefore hm€ P, XH, 
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C(P,)CPıxH and hence C(P,)=P,xH. This eompletes the proof 
of (4.4). ET aa f . 

If in (4.4) 3 is irreducible or has degree (p+1)/2, it follows from 
(4.3) and (4.2) that G/Z = LF (2, p) = G/H. In these cases-Z and H 
are both maximal normal subgroups of G and hence, since HZ G, H =Z. 
Therefore the Main Theorem has been established for the case p > 7 if it is 
known that a finite group of order p*g’ with (p,g’) —1 and p >? which has 
a-faithful representation of degree n < (2p-1)/3 over the complex number 
field has a normal abelian subgroup of order p* or p**. This fact readily 
follows from (1A). 


5. Proof of the Main Theorem when p< 7. If p isa prime with p & 7, 
then the group G under consideration is a finite linear group. over the complex 
number field of degree n=4. In his book [1] H. F. Blichfeldt has listed 
the collineation groups corresponding to all finite linear groups of degrees 
n—=2, 3 and 4 over the complex number field. His results will be applied 
after some reductions of the problem. 

Now let @ satisfy the hypotheses of the Main Theorem. Since 
n < (2p+1)/3 <p, (2.2) implies that a Sylow p-subgroup of G is abelian. 
If p==2, then n must be 1 and the result follows since @ is abelian. 

.. If p=3, then n< 7/3 <3, so that only the case n==2 need be con- 
sidered. Clearly, 3 may be assumed to be irreducible for otherwise G would 
have a faithful representation by 2 X 2 diagonal matrices and would be abelian. 
Hence, Schur’s lemma yields that the center Z of @ consists of all s for 
which [3(z)] is a scalar matrix. Thus, G/Z coincides with the collineation 
group of G. But from Blichfeldt’s list it is clear that either G/Z has a normal 
3-Sylow subgroup or is isomorphic to one of LF(2,3), 8, or As. By (2.6) 
this yields the desired result for @. 

‘If p= 5, then n<11/3<4 If n=} = (5—1)/2 the result follows 
from Theorem I. Hence it may be assumed that the faithful representation 
3 of G has degree 3. Suppose first that 3 is reducible. Ifg has three irreducible 
constituents, then G .would have a faithful representation by 3 X 3 diagonal 
matrices and, hence, would be abelian. Therefore, assume that 3 is the direct 
sum of two irreducible constituents 3, and ĝa, of degrees 1 and 2, respectively. 
Let K be the kernel of 32. Then 3, is a faithful representation of G/K. Let 
L be the normal subgroup of G such that L/K is the center of G/K. Then 
L is the set of all ve @ such that [3.(z)] is a scalar matrix and therefore 
L=2. By Theorem I either. G/K has a normal 5-Sylow subgroup or 
G/L = (G/K)/(L/K) = LF(2,5). Since KC L=Z, the desired result 
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follows from (2.6). It may therefore be assumed that a is an irreducible 
representation of G. 

G/K then coincides with the collineation group of G. Blichfeldt’s list 
shows that this collineation group either has an abelian normal Sylow 5-sub- 
group or G/Z = LF(2,6) or Ae By (2.6) this yields the desired result. 

When p=%n< (2p +1)/3=5. If n=}? < 3= (p—1)/2, then G 
has an abelian normal 7-Sylow subgroup by (2.3). If n==3, the Main 
Theorem follows from Theorem I. Hence suppose that G has a faithful 
representation 3 of degree 4. If 3 is reducible and if every irreducible con- 
stituent of 3 has degree less than 3 = (p—1)/2, then (2.3) yields that G has 
an abelian normal 7-Sylow subgroup. Therefore it may be assumed that 
if a is reducible, then it is the direct sum of two irreducible constituents, 
3ı and 3, of degrees 1 and 3, respectively. Let K be the kernel of 3.. 
Then by Theorem I @/K either has an abelian normal 7-Sylow subgroup or 
the factor group (G/K)/(L/K) of G/K modulo the center of G/K is iso- 
morphic to LF (2,7). The treatment of these two cases is similar to that 
used in the case p == 5. 

It may therefore be assumed that 3 is a faithful irreducible representation 
of degree 4. Hence G/Z is the collineation group of G. From Blichfeldt’s 
results this collineation group either has an abelian normal %-Sylow sub- 
group or is isomorphic to LF (2.7) or A; By (2.6) this suffices to give the 
desired result. The proof of the Main Theorem is now complete in all cases. 
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THE FULL IMBEDDING THEOREM. 


By BARRY MTTOHELL.! 


Introduction. The group valued imbedding theorem asserts that every 
small abelian category admits an exact, covariant imbedding into the category 
of abelian groups (Freyd [3], or Lubkin [6]). From this it follows that a 
statement concerning exactness and commutativity of a diagram in a general 
abelian category is true providing that it is true in the category of abelian 
groups. However, the non-fullness of the imbedding prevents one from 
handling statements which concern the existence of morphisms in a diagram. 
In this paper it will be proved that every small abelian category admits a 
full, exact, covariant imbedding into a category of ®-modules for some ring 
R. Thus any statement involving the existence of morphisms in a finite 
diagram which is true in all categories-of modules is true in the general 
abelian category. Composing such a full imbedding with the functor from 
modules to groups which forgets the R -module structure gives a further oe 
of the group valued imbedding theorem. 

In $1 we prove a number of results dealing with abelian categories satis- 
fying the axiom A.Bö of Grothendieck [5]. Some of these results were 
stated in [5], but since there does not seem to be proofs of them in print, 
I have chosen to include such proofs here. 

In §2 the Eckmann-Schopf techniques for injective envelopes are handled 
in the setting of the A.B5 category. Also it is shown here that every object 
in an A.B 5 category with a generator has an injective envelope. From this 
we reobtain the Grothendieck result that such a category has an injective 
cogenerator. 

Module categories are characterized in $3 as abelian eee (with 
infinite coproducts) which possess a small, projective generator. The theorem 
proved is actually a refinement of this statement, dealing with the case where 
the generator is not necessarily small. 

A quick review of functor categories precedes the proof ot the full im- 
bedding theorem in §4. The crucial theorem needed here states that the 
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category of kernel preserving functors from a small abelian category to the 
category of abelian groups is itself an abelian category (Freyd [3], or Gabriel 
[4}). oe | 

Finally in $5 we point out a generalization of the important Lemma 4.1 
and use it to construct a counter-example to the statement. that injective 
objects in the functor category ((,8) (Q, 8 abelian categories) are cokernel 
preserving as functors (a true statement when #3 is the category of abelian 
groups). l 

A part of the material in this paper was written as a thesis under the 
helpful supervision of David Buchsbaum, who in particular suggested that 
there exist a proof of 2.9 along the lines given here. I have also profited from 
talks with Peter Freyd, some of whose ideas I have used in $4. i 


1. Preliminaries. Unless otherwise stated @ will denote an abelian 
category with arbitrary coproducts (sometimes called direct sums. See [5]; 
axiom A.B.3). The coproduct of a family of objects {44} ; ez Will be denoted 
by © A, and u: Ar—> P 4 will denote the k-th injection. If Aj«=A for 

tel te 

all ¿€ J, then the coproduct will be denoted by 7A. If {Aj} rer 8 & family of 

subobjects of an object A (more correctly, if {A;—> A} is a family of mono- 

morphisms), then the union UA, is the image of the obvious morphism 
sel = 

€ 4>4. The union is the smallest subobject of A-which contains each of 

ter . 

the given subobjects. The intersection A, N A, of two subobjects Ar, Ae C A` 

is the kernel of the composition A, 2>A-— >A/A,. The intersection is the 

largest subobject of A which is contained in both A, and A, More generally, 

if f: A ->B is any morphism and B’ C B, then the inverse image f+ (B) C A: 


f 
is defined as the kernel of the composition 4A —> B > B/B’. HA’ CRB is 
the image of f then we have an exact sequence ' 


0f (B) > A> AJA NB >O. 


The inverse image is the largest subobject of A which is carried into B’ by f. 

Consider a family of objects {A4},,, where I is a directed set, and 
suppose that whenever +<j we have a morphism my: 4;—>A; such that 
WRT = Wik for IZSk and mH = La, (the identity morphism on Ay) for 
all i€ I. Then we call {Anr} a direct system over I. A cocompatible 
family for the direct system is a family of morphisms {(4,—4},,,such that 
whenever ij we have a commutative diagram 


icl 
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The above family is called the direct limit for {Ay} if given any other co- 
compatible family {44—>4’} there is a unique morphism A— A’ such that 


Avro At A =A, A’ 


for alli€ J. In this case the morphism A,— A is denoted by m, and the object 
A is denoted by lim > A; In abelian categories with coproducts..the direct 
—> 


tel 
limit can be taken as the quotient object 
(1) © Ai/ U Image (uy — upg). 
del j<k 


The morphism 7; in this case is just the composition of u, with the epimor- 
phism from © 4; onto the quotient object (1). On the other hand, if 
{A, m} and {A,m} are two direct limits for the same system, then one shows 
easily that the induced morphism A— A’ is an isomorphism. Hence up to 
isomorphism direct limits are unique. 

_ Let {4, x} and {A/,x’} be two direct systems over J. A morphism 
{Ayr} > {Al,w} of direct systems is a family of morphisms fi: A; A’ 
such that: my fı = fm; whenever i < j. Such a morphism induces a morphism 
f: AA’ of the direct limits. The following proposition follows easly from 
the axiomatic descriptions of cokernels and direct limits. 

PROPOSITION 1.1. If {A',m}> {4r} and {A,r} {4r} are 
morphisms of direct systems such that A > Ay—> Ai —> 0 is exact for all 4, 
then the direct limit sequence A>A—>A"—0 is exact. (In other words 
direct limits preserve cokernels.) 

Let {A;},,., be a family of subobjects of an object A. Define +57 if A, 
precedes A, as a subject of A. If I becomes directed under this ordering we 
say that the above family is a direct family of subobjects. Then taking my 
as the inclusion morphism from A; to A, we obtain a direct system whose 
direct limit is not in general a subobject of A. 


PROPOSITION 1.2. The following properties of a category are equivalent. 
a) The direct limit of a direct family of subobjects {Aj} is U Ay 
. tel 


b) If {Ai} is a direct family of subobjects of A and B is another sub- 
object, then 
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(2) (U 4:) N B= |] (4N B}. 
Proof. Assuming a), the direct limit of the family’ (A U B} is 
_ U (AU B) = (UA) UB. 


Using 1.1 we then sco that the direct limit of the system {A,U B/B} is 
(UA) U B/B. Hence again using 1.1 the family of exact sequences 


0>4,NnB>A> AU B/B>0 
gives us an exact direct limit sequence 
(3) 0> U (4N B) > U 4: > (UA) U B/B> 0 


But (3) is just another way of writing (2). 

Now assume b). We have the morphism u: D-»A induced from the 
direct limit D of the direct family of subobjects by the inclusion morphisms. 
Furthermore the image of u is |J 4; We wish to show that u is a mono- 
morphism. Let K be the kernel of u, and denote the image of 4; —> D by A/. 
Then D = |]J Ač, and so by b) we have K = |J (4f NK). If K is not zero, 
then A’ N K is not zero for some ¢ and consequently the inverse image of 
KN Aj in A, is not zero. But this means that A;,—> A has a non-zero kernel, 
contradicting the fact that it is a monomorphism. Hence K ==0, and so u is 
a monomorphism. 


` Proposition 1.2 proves the equivalence of two formulations of the Grothen- 
dieck axiom A.B.5 [5]. 
The proof of the following lemma is left to the reader. 


Lemma 1.3. Let {Ay} be a direct family of subobjects of A. Then the 
direct limit of the corresponding family of quotient objects is A/U Ay. 


Proposrrion 1.4. A.B.5 ts equivalent to the condition . 
(4) 0 o PUA) =U P (4) 


relative to any morphism f: B>A and any direct family of subobjects {A,} 
of A. 

Proof. Taking f to be the inclusion of a subobject BC A, we obtain 
equation (2). 


| 
Conversely, suppose that A.B. 5 is satisfied, and let f be any morphism. 
Let B’ be the image of f. Then we have an exact sequence 
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0> ‘ae (Ai) -> B- B’/A, NB’ 0. 
Passing to direct limits and using 1.3 we obtain an exact sequence 
(5) 0> Uf? (4) B> B/U (440 B’) > 0. 


‚ But by A.B.5 we have U (4:9 B’) =(UAi) AB. Hence (5) is just 
another way of expressing (4). 


PROPOSITION 1.5. Consider a direct system {Anr} ,,, in an A.B.5 
category. Denote Ky == kernel ry for ij, and denote K;—kernelm. Then 
for any index k we have 

K, = U Kx. 
k3Sp 


Proof. Let R be the set of ordered pairs of indices (1,5) such that t < j. 
For any subset S of R let 


As U Image(u— umy) CD Ar 
(J) ES tel 


Then by (1) we have lim > 4, = @ 4;/år. Also we have Ar= |] Ar 
ar del F 
where F runs through all finite subsets of R. Therefore by 1.4 we can write 


Ky == ux (Ar) — y ty 1 (Ap). 


Hence the proposition will be proved if we can show that for each F there is 
an index p such that ux*(Ar) C Krp. We take for p any index which follows 
k and all indices which appear in either first or second position of a member 
of F. Now ur!(Ar) is the kernel of the composition 


(6) Ay Ð A; Q Ay/Ar. 
tel sel 


Define f: D A— 4, by taking fur, for ip and fu =0 otherwise. 

Then f eh Tkp in (6). Moreover for (1,5) € F we have f(u — umy) —=0. 

Hence f factors through ®Ay/Ar in (6). From this it follows that 
sel 

u’ (Ap) Cc Krp. 


Prorosrrron 1.6. A.B.5 is equivalent with the assertion that direct 
limits are exact. 


Proof. If direct limits are exact, then the limit morphism of direct family 
of monomorphisms A,— A, which can be regarded as a morphism from {Aj} 
to the constant direct system which as A at every index, is a monomorphism. 
Hence by 1.2 A.B.5 is satisfied. 
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Conversely suppose that A.B.5 is satisfied. Since in any case direct 
limits preserve cokernels (1.1) it suffices to show that the limit morphism 
f: 4B of a family of ‘monomorphisms fi: 4g B; defining a morphism 
from the direct system {A,,7},,, to the direct system {B; Mea is a mono- 
a Consider the commutative diagram 


fe 
A— By 
My H 
f 


where K is the kernel of f. Denoting Aj =imagem we have A = |) Aj. 
By A.B.5 we then have K = |J (A/NK). Suppose K0. Then A/NK 
0 for some 1. Letting M =r (Ai NK) we have m | M340 whereas 
mfi | M—0. Then MC Ya by 1.5, where Ly==kernelny, and so again 


using A.B.5 we can T M = =, (ZyNM. But Ly M, considered as a 


subobject of A,, must go into zero one wy since A> B; is a monomorphism. 
Hence Ly N M goes into zero under m for all j, and consequently r | M =0. 
This contradiction proves that K ==0, and so f is a monomorphism. ` 


2. Injective envelopes. Following Eckmann and Schopf [2] we define 
an essential extension of A’ to be a monomorphism A’—>A such that every 
non-zero subobject of A intersects A’ non-trivially. In the category &* of 
right -modules A’ C A is an essential extension if and oy if for each 
a0 in A there is an reR such that Oare A’. 


Lemma 2.1. Let u: A’ A be a monomorphism. Then the following 
are equivalent. l 


a) -u 18 an essential extension. 


b) Every morphism f: A>B Pr that fu is a monomorphism 18. 
monomorphism. 


Proof. a) => b) Iff ts not a monomorphism, then K = kernel f 0, 
hence KM A’40. But K N A’ C kernel (fu). Therefore fu is not a mono- 
morphism. ' 


b) => a) If u is not an essential extension, then there is a non-zero 
subobject B of A such that B N A’ ==0. But this means that the composition 
A’ —> A —> A/B is a monomorphism. Therefore by b), A —> A/B is a mono- 
morphism, which is not so. ' 
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. Given morphisms u: A’—> A and f: A’— B, we form the quotient object 
. ‘P= A D B/Image (usu —usf) 


where ta and un denote the injections into the coproduct. Letting g and v 
denote the compositions of u, and ug respectively with the natural epi- 
morphism AB BP, it is clear that we have a commutative diagram 


u 
A’ — A 


(1) | [o 


, B ——> P ; 
The diagram (1) is called the pushout of the two morphisms u and f. 


Lemma 2.2. Ifin the pushout diagram (1) the morphism u is.a mono- 
morphism, then so is v. 


- Proof. Let K satana v, and suppose K £0. Denote ET 
Then us(K)C Imageh. Therefore K’ == ht (us(K)) 40. Letting pa be 
the projection AB B— A, we have pah — pa (uau —tpf) =u. Since u isa 
monomorphism this means that pık(K’) 40. But 


BaAh(E?) — pah(h*(un(E))C paus (E) =0. 
This contradiction proves the lemma. 


For the next lemma we need the following definitions. We call a category 
locally small if every object has only a set of (equivalence classes of) sub- 
objects. We say that a morphism u: Aı>A is a retract if there is a 
morphism pı: A—>4, such that pıtı = 14. In an abelian category the 
morphism u is a retract if and only if there is a subobjeet A, C A such that 
A is the coproduct of A, and A, with u, as the first injection. Also for 
abelian categories a union A, U A, of two subobjects is a coprodnct if and 
only if A, A,==0. 


Lemma 2.3. Let Q be an object in a locally small A.B.6 category. 
Then the following are equivalent. 


a) Q is injective. 
b) Q admits no proper essential extensions. 


c) Q isa retract of every object which contains it. 
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Proof. a)—>b) Suppose that u: Q>A is an essential extension. 
Since Q is injective we can find a morphism p: A— Q such that pu == 1q. 
That is, Q is a retract of A. Letting Q be such that A =: Q ® Q’ we have 
QM Q’—0. Since u is an essential extension this means that Q’ —0. Hence 
u is an isomorphism. _ 

b) => c) Suppose that Q admits no proper essential extensions. Let 
Q be a subobject of A but not a retract of A. Let @ be the set of subobjects 
of A which intersect Q trivially. If {A;} is a linearly ordered subset of 6, 
then by A.B.5 we have 


O=U (4N 0) = (U 4) NQ. 


This shows that @ is inductive and so has a maximal element A’. Now 
Q =Q A/A C A/A’. Since Q A4, A/A’ is a proper extension of 
Q, hence is not essential. Let B be a non-zero subobject of A/A’ which inter- 
sects Q trivially. Then B is of the form B/A’, where B is a subobject of A 
and A’ is a proper subobject of B. Furthermore since BN Q==0 and 
A'N Q =0, we must have BN Q=0. But this contradicts the maximality 
of A’. 

c) => a). Consider a monomorphism u: A’-> A and a morphism f: 
4’—>0Q. We wish to find kh: A—Q such that hu =f. We form the pushout 
diagram 

u 
A’—— >A 


| |. 


Q0-———>P 


where by 2.2 we know that v is a monomorphism. Then c) says that we can 
find w: P>Q such that wv = lọ. Hence we can take h—wg. 


- The following lemma is left to the reader. 


Lemma 2.4. If u: A>B and v: BC are monomorphisms, then vu 
is an essential extension if and only if both u and v are essential extensions. 


Lemma 2.5. Suppose that {4} ts a direct family of subobjects of A 
in an A.B.5 category and suppose that each is an essential extension of a sub- 
object A’ of A. Then |) A; is an essential extension of A’. 


Proof. Let B be a non-zero subobject of |] Ay. By A.B.5 we have 
B == |] (4:0 B) and so AAN B0 for somei. Hence since A, is an essential 
extension of A’, we have A; N B N A’=40, and so A’ intersects B non-trivially. 
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A functor T: Q — B is called faithful if for every pair of objects A,, As 
in @ the induced function 


(2) [A,, á:] a> [T (Ax), T(As) ls 


is univalent, where [A,, As] denotes the group of morphisms from A, to Áa 
A faithful functor which takes distinct objects into distinct objects is called 
an imbedding. If on the other hand (2) is always onto, then T is called full. 

Given an object Ted, consider the abelian group valued functor T: 
ad $% defined by T(A)=[U,A]. Then U is called a generator for Q if 
T is an imbedding. That is, U is a generator if for any non-zero morphism 
f: A>B there is a morphism g: U>A such that fg>£0. Equivalently U 
is a generator if whenever A’ is a proper subobject of A there is a morphism 
U —> A whose image is not in A’. From this we see that a subobject of A is 
determined (up to isomorphism of subobjects) by the morphisms U — A which 
factor through it. Since [U,A] is a set for all A, it follows that a category 
with a generator is locally small. 


The following lemma is immediate from the definition of generator. 


Lemma 2.6. Uisa generator for A if and only if for every object 
AEC the morphism 410 —> A whose g-th coordinate ts g is an epimorphism. 


If U is a generator for @, then an object will be called finitely generated 
(with respect to U) if it is a quotient of an object of the form 1U for some 
finite set J. Clearly the union of two finitely generated subobjects is also 
finitely generated, and consequently the finitely generated subobjects of an 
object A comprise a direct family of subobjects. If @ is an A.B.5 category 
it follows from 1.2 that the direct limit of the family is A. 


If U is projective, then U is a generator if and only if [U,A]0 for 
every non-zero object A in @. From 2.6 it follows that a category with a 
projective generator has projective resolutions. In the category of right 
(resp. left) R-modules YR (resp. ZA) a projective generator is œ con- 
sidered as a right (resp. left) module over itself. 

Dually € is called a cogenerator if for any non-zero morphism f: B>A 
there is a morphism g: A — C such that gf 40. If C is injective then it is a 
cogenerator if and only if [4, C] 40 for every non-zero object A. It is well 
known that an abelian group is injective if and only if it is divisible (see 
for example [1], page 8, Theorem 3.2). Consequently if @ denotes the 
additive group of rational numbers and Z denotes the integers, then Q/Z is 
injective. Using this it is not difficult to construct a non-zero morphism of 


il 
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groups G—>0Q/Z for every non-zero abelian group G. Hence Q/Z is an 
injective cogenerator for the category of abelian groups &. Then using the 
obvious natural equivalence of functors of the right R-module A 


[4, [R, Q/Z\¢ =~ [A, Q/Z\cl¢ 


we see that [R,Q@/Z]g considered as a right R-module is an injective co- 
generator for 4%, Likewise [R, Q/Z]ç considered as a left R-module is an 
injective cogenerator for R4. l 

Given U€ Q, let R denote the ring of endomorphisms of U. Then for 
AEC the group [U, A] can be considered as a right R-module by defining 
the operation of the ring element r€ [U, U] on the group element a€ [U, A] 
as the composition are [U,A]. Hence the functor T defined by F(A) 
== [U,A] may be considered as having values in the category of right R- 
modules. 


‘Luma 2.7. If U is a generator, then T: A—> HR preserves essential 
extensions. 


Proof. Suppose that u: A’—A is an essential extension in Ĝ, and let 
f be a non-zero element of T(A)=[U,4A]. We must find re R =[U,U] 
such that O>£ fr and fre [U,A’] (or more precisely, Image(fr) C A’). Since 
u is an essential extension we have A’NImagef>£0. Therefore we have a 
commutative diagram 


F 
f(A’) — a" 


f 


U———> B 


where f £0. Let g: U->f+(A’) be such that g>£0. Then we can take 
vg as the required r. 

If u: A>Q is an essential extension and Q is injective, then u is called 
an injective envelope for A. - 


Proposition 2.8. If u: A>Q and u: A— Q are injective envelopes 
for A, then there is an isomorphism Q =Q, (not necessarily unique) such 


that the diagram 
A 
uf \e 
Q = Q 


is commutative. 
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Proof. Let 0: Q— Q, be such that u, = pu (injectivity of Qı). Then 
6 is a monomorphism (essentiality of u) and so by 2.4 @ is an essential 
extension (essentiality of u). Therefore.6 is an isomorphism (injectivity 
of Q). 


Trrorrm 2.9. An A.B.5 category with a generator has injective 
envelopes for each of its objects. 


Proof. Let T:and R be as above, and let T(A)—M be a monomor- 
phism of right R-modules with M injective. Consider the class @ of all 
triples (B,u,f) where u: A>B is an essential extension and f: T(BJ>M 
is such that the diagram 


T (u) 
T(4) ——> T(B) 


A 


is commutative. By 2.7 T(u) is an essential extension and so by 2.1 f must 
be a monomorphism. We order @ by defining (B,u,f) = (B',w, f) if there 
is a morphism v: B — B’ such that vu == w and such that the diagram 


T(v) 
T(B)——T(P’) 


NA r 


is commutative. Such a v must be a monomorphism since u is an essential 
extension. Furthermore it must be unique. For if y were another then 
fT(v)=fT(v), and so since f is a monomorphism and T is faithful we 
have v= y. It follows that if also (B’,u’,f’) = (B,u,f) then v is an iso- 
morphism. In this case we shall say that (B,u,f) and (B', w, f) are equi- 
valent. Now since f: T(B)—M is a monomorphism we see that the 
cardinality of T (B) —[U,B] is less than or equal to the cardinality of M. 
Consequently by 2.6 B can be written as a quotient of MU. But Q having a 
generator is locally small, and consequently there is no more than a set of 
quotient objects of MU. It follows that the class &, of equivalence classes in 
6 isa set. Let { (Bi, ty fi) } represent a linearly ordered subset of o. Then 
using uniqueness of the morphism v, we se that A together with the B/s form 
a direct system in which all the morphisms are monomorphisms. Therefore 
using 1.5 we can regard this direct system as a directed family of subobjects 
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of the direct limit B,. Moreover by 2.5 the inclusion u: A->B, is an 
essential extension. Now T(A) together with the 7’(B,)’s form a direct 
family of submodules of 7’(B,), and so the compatible family of morphisms 
fi: T(B) > M defines a limit morphism f:UT(B)>M which can be 
extended to a morphism fo: T (Be) > M by injectivity of M. Thus the class 
of (Bo, uo fo) dominates every (Ba tx, fi) and so we have shown that 6, is 
inductive. Applying Zorn’s lemma we have a maximal member (Q,w,h). 
If Q were not injective, then by 2.3 we could find a proper essential extension 
v1: QQ, and by 2.4 vw is an essential extension. Also by injectivity of 
M the morphism h could be extended to a morphism hı: T(Q.1) > M. But 
this contradicts the maximality of (Q,w,h). Therefore Q is injective, and so 
w is an injective envelope for A. 


Proposition 2.10. If Q has injective resolutions and a generator, then 
Q has an injective cogenerator. 


Proof. Consider a monomorphism & U/V—Q where U is the genera- 
YoU 


tor, V runs through all subobjects of U, and Q is injective. We'show that Q 
is a cogenerator. It suffices to show that for any A540 there is a non-zero 
morphism A>0Q. Since U is a generator there is a non-zero morphism 
U>A. The image of this morphism is U/V, for some subobject Vo U. 
Then by injectivity of Q the non-zero composition U/V,.> ® U/V >Q can 
be extended to a morphism A—>Q as required. l 


Combining 2.9 and 2.10 we obtain 


COROLLARY 2.11. An A.B.5 category with a generator has an injective 
cogenerator. 


The following proposition shows that injective envelopes may exist even 
when @ does not have a generator. 


PROPOSITION 2.12. Let A be.an object in a locally small A. B.5 cate- 
gory and suppose that A is a subobject of an injective Q. Then A has an 
injective envelope. 


Proof. Consider the set @ of all subobjects of Q which are essential 
extensions of A. Then by 2.5 @ is inductive, and so let Q, be maximal in @. 
If Q is not injective then by 2.3 there is a proper essential extension 
u: Qo—>B. Since Q is injective there is a morphism v: BQ such that 
vu is the inclusion Qe C Q. But since u ig essential v is a monomorphism. 
Hence using 2.4 we see that B is an essential extension of A in Q, contra- 
dicting the maximality of Qo. Therefore Q, is injective. 
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_ 8. Characterization of module categories. A functor T: 2-8 (Q 
and @ not necesssarily abelian) is called an equivalence if it is a full imbedding 
such that every object BE is isomorphic to T(A) for some A€ @. It is 
not difficult to prove that 7’ is an equivalence if and only if there is a functor 
S: B—>Q such that ST and TS are naturally equivalent to the identity 
functors on @ and 8 respectively. Furthermore 8 and T preserve any 
situation in a category which can be described in terms of universal mapping 
properties (kernels, products, intersections, ete.). In other words if T: @ —> 8 
is an equivalence (or if @ and B are equivalent as we shall say) then for all 
practical purposes @ and @ are the same. 

An object U in an abelian category is called small if every morphism 
from U into a coproduct U—> ® A, factors as UV > P, A> ® A; where J 


is a finite subset of I and the morphism between the coproducts is the one 
which preserves injections. Denoting T(4)—[U,A] one can easily show 
that U is small if and only if T preserves coproducts. In the category 8* the 
ring R considered as a right module is a small projective generator. On the 
other hand:if @ is a category with a small projective generator U, then the 
following theorem shows that ( is equivalent to a category of modules. We 
also give an analysis of the situation where U is not necessarily small. This 
will be needed in the sequel. 


THEOREM 3.1. Let Q be a category with a projective generator U and 
let R denote the ring of endomorphisms of U. Then the functor T: A> HR 
defined by T(A) == [U, A] is an exact imbedding. The induced function 


[4, B] > [T(A), T(B)] 


is onto whenever A is finitely generated. If either U is small or G ts A.B.5, 
‘then T is full. T is an equivalence if and only if U is small. 


Proof. The conditions that U be projective and a generator are equiv- 
alent to T being exact and an imbedding respectively. We must show that 
‘if A is finitely generated, then every morphism of #-modules ®:[U,A] 
-> [U, B] can be realized as T’($) for some #€ [A,B]. That is, we must find 
¢ such that 6(f) —9f for all f€ [U, A]. Suppose first that 7—A. Then 
we have 


(f) = &(1y) =8(1v)f, 


the last equality being true since ® is f-linear. Hence in this case we may 
take == (1v). 
l Now assume that we have an exact sequence 
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m 
0> K —— 1U — A> 0 


where / is finite. Consider the composition 


T (ux) T(x) > 
[U, U] ae [U, 10] = LU, A] m [U, Bj 


and call it &,. Then we have shown above that we can find &&: U —> B such 
that .(f) def for all f€ [U, U]. The dy’s then define a morphism ¢: 
IJ» B. If we denote © as the composition T (r) and denote the k-th pro- 
jection from the eoproduct by pr, then we have 


(f) = ®(xf) =P (r X upp) 
(1) -2 P (mupf) = &;( pif) 
= 3 pips = $f. 
4er 


We show that gA=0. If ¢A5<0 then there is a morphism «: U->K. such 
that daa £0. But 
Badia) = (Aa) == 0, 


a contradiction. Therefore ¢A=0, and so & induces ¢: A>B such that 
ġr= $. Now take any f: U>A. Then since U is projective we may write 
f = ng where g: U>!U. Hence using (1) we have 


&(f) =d (7g) =E (g) = $g = prg = of. 


If U is small, then the above goes through even when A is not finitely 
generated. For if f: U—>!U (where I is not necessarily finite) then we may 
assume that f factors through ’U where J is a finite subset of I, and then in 
(1) we can write f= 2 upf. 


Now suppose that @ is A.B.5 (but that U is not necessarily small). 


Given an object A we can write A = = A, where {4;} ¿eris the set of all 
4e 
finitely generated subobjects. For each i€ I define &, as the composition 
® 
LU, As] > [U, 4] ——> [U,B]. 


Then each & is determined by a &: Aı—>B. Furthermore the ¢/s are unique 
since T is an imbedding. From this it follows that {¢,} is a cocompatible 
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system and so there is an induced morphism ¢: A>B. Now if fe [U,A] 
then. image f is an A, for some i, and so we can write f.= mg where g: U —> Ay 
and 7; is the inclusion 4;—> A. Then 


D(F) = O(mg) = (g) = pg = org = of 


and so œ is the required morphism. 

Finally, if T is an equivalence, then U is small since its image R is 
small in &*. Conversely suppose that U is small and let M be any right 
R-module We may write an exact sequence of 0&-modules: 


IR —— R > M> 0. 


Since U is small, T commutes with coproducts, and so TU) =! and 
T(/U) =/R. Since T is full we have 6=T7'(¢) for some ¢. Then since T 
is exact we have MS T(C) where C is the cokernel of ¢. This proves that 
T is an equivalence. 

As an immediate application of 3.1, let U — "R in the category 4? where 
n is any positive integer. Then U is a small projective generator. The ring 
of endomorphisms of U is isomorphic to the ring M„(R) of all n X n matrices 
over æ. Consequently for any integer n the categories HR and#™%) are 
equivalent. A consideration of opposite rings shows also that RY and MR 
are equivalent. This will be considered as a part of a more general picture 
in a forthcoming paper. © 

As a further application we can show that the property of freeness for a 
module is not preserved under equivalences of categories. Let R be a com- 
mutative ring, and take U =R R. Under the functor T of 3.1 the 
R-module æ corresponds to the A-module [R ® &, R] whereA=—[R O RR, 
R DR]. We show that every non-zero element of [R O R, R] has torsion, 
so that in particular [R @ R, R] cannot be free. Let f be any such element. 
Suppose f(1,0) =r and f(0,1) ==s. Then r and s are not both zero. Hence 
(s,—r) is a non-zero element of R @ R. Letting g: N PR R ORM be 
such that g(1,0) =g(0,1) = (s,—r) we see that g is a non-zero element 
of A such that fg—0. 


4, The full imbedding theorem. Let @ and B be any additive cate- 
gories and supose that @ is small (that is, the objects of @ form a set). 
Then using natural transformations as morphisms the additive covariant 
functors from Q to 8 form an additive category which we denote by (Q, 8). 
If 8 has kernels, then the kernel KS of a morphism S>T in (Q, 8) 
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is such that K(A)—>S(A) is the kernel of $(A)> T(A) in @ for al AEG. 
‘Likewise if 8 has coproducts then the u KA T; in(d, a is given 
“pointwise” by the relation 


(@ 7) (4) — @ TA). 
del sel 


By such pointwise considerations it is not hard to show that if 8 is abelian 
then so is (Q, ®) for any small additive category @, and that if 8 is A.B. 5, 
then so is (Q,8). In particular this is true when B == $. In this case we 
have for each A€ Q the object H4e (QA, 8) defined by H4(A’) = [4,47]. 
Clearly a morphism A,— A, induces a natural transformation H4:—> H^ and 
in this way we can regard H: > (Q, 8) as a contravariant additive functor 
which takes cokernels into kernols. We have the following lemma which has 
become standard. i 


Lemma 4.1. Let Q be any additive category and let T: A> bea 
covariant additive functor. Then for any AE G we have an isomorphism of 
groups . i 
(1) 6: [H4,TI>T(A). 


which is natural in both T and A. 


Proof. We give only the definition of @ and its inverse and leave the 
details to the reader. We define 0 by the rule (4) —=n4(14) for 'a ‘natural 
transformation 7: H4 —> T. The inverse is given by (s) (f) = Pf) (2) 
for zeT(A) and fé [4,A’]. 


It follows from 4.1 that for each 4€ Q (Q small) the functor H4 is 
projective in (Q, %). For if $>T is an epimorphism in (@, &) then the 
induced morphism [H4,9]— [H4,T] is equivalent to S(A)->T(A), and 
the latter is an epimorphism in $ since the epimorphisms in (Q, $) are 
characterized as being pointwise epimorphisms. Since a coproduct of pro- 
‚jectives is again projective we see that (DB H4 is projective. Then for any 
TA (d,&) we have Aca 

[ O H4,T] = az X T(A). 
. Aca Act 
: Now XT(A) is zero only if T is zero. Consequently 8 H4 jisa generar 
for (Q, $). 

Now let @ be a small abelian category, and let £ (Q, 4%) denote the full 

subcategory of (Q, 8) consisting of all kernel preserving functors. Since 
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the kernel in (Q, $) of a morphism of two kernel preserving functors is again 
‚kernel. preserving, it follows that (Q, $) has kernels. However, it is not 
obvious what the cokernel of a morphism in (4G, &) should be, or even that 
such exists. Nevertheless, Freyd [8] has proved the following theorem, which 
we state without proof. The result also follows from work done previously by 
Gabriel [4]. 


THROREM 4.2. If Q is any small category then £(G,%) is abelian. 


It follows from the fact that coproducts in & preserve kernels that the 
coproduct in (Q,&) of a family in (G, $) is also in (Q, $). Conse- 
quently & H4 is in (Q, 4%), and so it is a generator for (Q, 4) (but 

Ae 


not necessarily projective). Also since & is A.B.5 we see from 1.6 that the 
direct limit in (2, &) of a direct system in (Q, $) is again in (Q, 8). 
Then again using the fact that & is A.B.5, a pointwise consideration shows 
.that direct limits in (Q, 4) are kernel preserving. Consequently 2£(Q,&) 
is A.B.5. Therefore by 2.11 (Q, $) has an injective cogenerator. 


Lemma 4.3. If Q is a small abelian category, then the functor H: 
‘A—> L(Q, Y) which assigns to the object A the functor H4 is an exact, contra- 
variant, full imbedding. 


Proof. Replacing T by H? in 4.1 we obtain [ H4, H?|~ H(A) —[B, A]. 
This shows that H is a contravariant full imbedding. Since H takes cokernels 
into kernels, to show exactness it suffices to show that if B>A is a mono- 
morphism in @ then HA> HB is an epimorphism in (2,4). Letting Q 
be a cogenerator for £ (Q, &), it then suffices to show that [H?, Q] > [H4, Q] 
‘is a monomorphism in &. But by 4.1 this is equivalent to Q(B) > Q(A) 
which is a monomorphism since Q is in £((, 8). 


THEOREM 4.4 (The Full Imbedding Theorem): Every small abelian 
‚category Q admits a full, exact, covariant imbedding into a category H * for 
- some ring R. 


Proof. Composing the functor H: @ —> (Q, $) with the duality functor 
on the range category we obtain a full, exact, covariant imbedding H* from 
d to a category with a projective generator. Now since @ is small, by 
replacing the generator with the coproduct of a sufficient number of copies 
of itself we may assume that every object in the image of H* is finitely 
generated. The theorem then follows by composing H* with the functor 7 
of 3.1. 
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5. Injective functors are not necessarily cokernel preserving. Let Q 
be injective in the category (Q, &) where @ is a small abelian category, and 
consider an exact sequence in 

A>B>(-0. 


Then the sequence 0> HC > HB > HA is exact in (Q, $) and so since Q is 
injective the sequence 


[H4,Q] > [8#,91> [H%,Q] > 0 


is exact in $. But by 4.1 the last sequence is equivalent to Q(A) > Q(B) 
Q(C)—>0. In other words an injective in (Q,&) is cokernel preserving as 
a functor. This fact is put to strong use in the work of Freyd [3], and in 
particular in the proof of 4.2. One may hope to generalize a number of the 
results in [8] by showing that if 8 is a reasonably nice abelian category, 
then injectives in (Q,8) are necessarily cokernel preserving. However, we 
are going to show that this need not be true even when @ is a category of 
modules. In fact we shall show that an injective functor need not. even 
preserve epimorphisms. 

Let @ and Q’ be any Sa additive categories, and Be, the functor 
category (Q,(Q’,&)). This last is the same as the category of covariant 
additive group-valued functors of two variables. For A€ @ and A’€ Q’ define 
HA4@H4€ (d,(0’,&)) by HA®H4(B,B') —[A,B]®@[A’,B’] where 
Bed, B'e Q’, and the tensor product is over the integers. Then for 
Te (Q, (Q, %)) it is not difficult to exhibit an isomorphism 


[HiQ H4’,T] ~T(A, A’) 


which is natural in A, A’, and T (Cf. 4.1). Then precisely as in §4 we can 

show that @ H4®@H*' is a projective generator for (@,(@’,&)). 
(AA )Ea Xa’ 

Hence the latter being an A.B.5 category with a generator has an injective 

cogenerator. (By considering n-fold tensor products we can generalize this 

result to additive functors in any number of variables). 

In particular let Q’ be a ring œ (that is, an additive category with a 
single object A’) and denote HA® HA by HAQ R. Then the functor category 
(@’,&) in this case is just the module category *&. Also let Q be a full 
subcategory $, of & consisting of one member from every class of isomorphic 
finitely generated abelian groups. Then &, is small, and it follows from tho 
fact that Z is noetherian that $, is abelian. Let Q be an injective cogenerator 
for the category (%o,%&) where Z, denotes the ring of integers reduced 
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modulo n. Consider the epimorphism f: Z2,>Z, in $, defined by f(1) —1. 
Then f induces a natural transformation 


n: H42@Z,—> H48 Z. 
Evaluating 7 at Z,€ & we have 
(1) [2,2,]82,> [2,2,]1 OZ, 


Using the identifications [Z.,Z,] = Z, and [2,Z,] ~ Z, the morphism (1) 
becomes g® 1: Z,@2Z,—>2Z,@Z, where g is multiplication by 2. It follows 
that g®1 == 0, whereas Z: 8 Z, © Z, is not zero. Hence g®1 is not a mono- 
morphism. Since a monomorphism of functors must be pointwise a mono- 
morphism it follows that y is not a monomorphism. Since Q is a cogenerator 
we then see that 

(2) [H*@ Zz, Q] > [E> 8 Z 9] 


is not an epimorphism. But (2) is equivalent to Q(Z,) >Q(Z:). Therefore 
Q does not preserve epimorphisms. 

However, if the ring R is flat considered as an abelian group (that is, 
if R is a torsion free group) then arguments similar to the above show that 
for any small abelian category an injective object in (Q, 24) is necessarily 
cokernel preserving. 
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ALMOST ACYCLIC MAPS OF. MANIFOLDS. . 


By Kyune WHan Kwon and Frank RAYMOND.? 


1. Introduction. A map is called proper if the inverse image of each 
compact set is compact. A proper map is said to be acyclic over a coefficient 
domain L if each point inverse is cohomologically trivial over L. If a state- 
ment concerning acyclic maps does not mention L, L should be assumed 
to be an arbitrary but fixed principal ideal domain. The cohomology theory 
we use is the sheaf-theoretic one [3], and therefore, it may, be interpreted 
as Cech or Alexander-Spanier cohomology if the space is paracompact or if 
it is locally compact and compact supports are used. We use the homology 
theory defined by Borel and Moore in [2]. To avoid repetition, we will say 
that a map f: (X,A)— (Y,B) is admissible if (1) f is proper, (2) (X,A), 
(Y,B) are locally compact Hausdorff closed pairs and 2. F(A) =B and 
f(X—A) =Y—B. 

The first part of the paper deals with the following question : 

Suppose f:(X,A)—(Y,B) is an admissible map such that f | X — A 
is acyclic. Under what conditions is f acyclic? 

Since even when f is a relative homeomorphism, anything could happen 
to A, the above question is considered by imposing some structure on X and 
demanding f to preserve it. 

The two theorems along this line are the following : 


. Tmeorem 1. Let f:(X,A)> (FY, B) be an admissible map, where A 
and B are collared in X and Y, respectively. If FIX—A is sa ‘then 
f ts acyclic. 


Teeorem 2. Let X, Y be locally orientable De n-manifolds 
with boundary and f:(X,BAX)— (Y,BdY) be an admissible map. If 
f | Int X is acyclic then f is acyclic. 


Recall there exists an example of a proper map of euclidean 3-space, 
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E, onto itself which is not acyclic even though it is a homeomorphism 
between two dense open subsets of E, see [1]. Theorem 1:or 2 implies that 
in a similar situation in case of manifolds with boundary, “wrong” point 
inverses, if they exist, cannot be confined to the boundary only. 

Most of the remainder of the paper studies the cohomology of the set A 
when f:(X,A)— (Y,B) is an admissible map between manifolds. 

The next theorem imposes strong cohomologieal conditions on upper 
semicontinuous decompositions (proper maps) -of manifolds for which the 
decomposition spaces are again manifolds. 


Turorem 3. Let X be a connected orientable generalized n-mantfold and 
Y a locally orientable generalized n-manifold (n— gm). Suppose f: (X,A) 
—>(Y,B) isan admissible map such that f| X—A is acyclic, and AAX. 
Then u 
(1) HF) ts a direct summand of H(X) for each p; 
(2) if H.2(B) 0, q>0, then the sequence 

feo r 
0> He (Y) —~—> H?(X) ——> H 2 (A). > 0 

is exact and splits for p> 0 and 
ft: H,(B)>H,(A) 
is an tomorphems 

(3) if H4(X) =0, q0, n, then 

f*: EREE 

is an isomorphism for all p. 


We have the following corollaries to Theorem 3. 


COROLLARY 1. Let X be a compact connected orientable n— gm and A 
be a closed subset of X. Let Y be the space obtained from X by shrinking 
A to a point. If Y isa gm then, H,*(X) #H.*(Y) tf and only if A: ts 
cohomologically non-trivial. 


This answers in the negative the question whether one can shrink to 
a point a cohomologically non-trivial continuum in some compact manifold 
and still get a homeomorphie space. John Hempel points out that this 
question is answered in the affirmative if the compactness is dropped. 


COROLLARY 2. Let f: XY be a proper map of an orientable n— gm 
X onto ann— gm Y. Further suppose that H,*(X) is isomorphic to either 
H,*(8") or Hs? (Er). Then the singular. set B of f cannot be 0-dimenstonal. 


640 KYUNG WHAN KWUN AND FRANK RAYMOND. 


Here the singular set of f is the set Ol{yEeY|f*(y) is not coho- 
mologically trivial} and the 0-dimensionality is used in the sense that each 
point has an arbitrarily small neighborhood which is both open and closed. 


COROLLARY 3. Let f: X—>T be a proper map of an orientable n— gm 
X ontoan—gm Y. Suppose either H* (X) =H,*(8") or Ho*(H*). If 
H,*(Y) @H*(X) then the singular set of f is all of Y. 


t 


Thus if one starts with an n— gm like Er or S”, one cannot change the 
homology without having every point of X belonging to the closure of the 
union of the cohomologically non-trivial inverse sets. 


COROLLARY 4. Let X be a generalized n-cell and A be a closed subset 
of X. If the space Y obtained from X by shrinking A to a point is a locally 
orientable generalized manifold with non-empty boundary then A is coho- 
mologically trivial. 


A manifold may be mapped onto a manifold of higher dimension. 
Theorem 4, whose proof is similar to the proof of Theorem 3, restricts the 
possibility of such phenomena. 


THEOREM 4. Let f: X—>TY be a proper map of a connected orientable 
n—gm onto an m— gm, m>0. Let H*(f*(y)) =0, kSs, n<2(s+1) 
all ye Y. Then. 


(a) either f is acylic and n == m, or else m<s when n < 2(s+ 1) and 
mSs+1 when n—=2(8+1); 


(b) if there exists y.€¥ such that H (f*(yo)) 0 (and if 
n==2(34+1) with m&s, then also assume that H,ı(X)—0), then 
nm -+ (s+1). 

Theorem 3 leads one to suspect that, in general, the inverse image A 
of the singular set must satisfy a homological condition resembling Poincaré 
duality. To be precise let f: X —> Y satisfy the hypothesis (2) of Theorem 3 
and let X be compact. Then 

THEOREM 5. The diagram (p>40,n) 

+ 4* 
0> H*(¥) ——» H*(X) —— H(A) >0 
(6.1) . fa ja ly 


fs ja 
0 Hppl( E) Hno) Hpo (A) <0 
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is commutative, the rows split and the vertical maps are isomorphisms induced 
by Poincaré duality. In particular, all modules are finitely generated. 


2. Proof of Theorem 1. If f: XY is a proper acyclic map of a 
locally compact space X onto a locally compact space Y, then f*: H*(Y) 
-> H*(X) is an isomorphism. For paracompact X and F this is well known 
and we suspect that the general case is also known. A simple proof is given 
in [5]. We also recall that A is collared in X if there exists homeomorphism 
h of A X [0, 1) onto an open subset of X such that h(a,0) — a for each a€ A. 

To prove Theorem 1, it suffices to show that for each b€ B, f*: H*(b) 
— H*(f*()) is an epimorphism. 

For any fundamental system {Ua} of neighborhoods of b, {Va}, Va 
«= f1(U,) is a fundamental system of neighborhoods of f*(b). And there- 
fore, , 

H* (b) == dir lim H* (Ua) 
(1) H* (f+ (b)) — dir lim H* (Va). 


Let ce H*(f*(b)). Then c is represented, in the relation (1), by some 
d € H*(Va). Let V be a neighborhood of f*(b) such that V C Va and 
V=(VNA)X[0,1) with each ve VNA corresponding to (v,0). We 
may also assume, with no loss of generality, that Ua = (Ua N B) X [0,1) 
with each ve Ua N B corresponding to (4,0). 
Consider the following commutative diagram. 
RL 


ta 
H* (Ua) ——> H* (Ua— B) 
far fa* 
ta 
H* (Va) —> H*(Va—A) 


Y w 


i 
H*(V) ——> H*(V—A) 
where all homomorphisms are induced by f or inclusion, and ix’, fa* and + are 
isomorphisms. 
Now c is also represented by c’—?(c’). There exists an element 
d, € H* (Ua) such that 
tafa (d1) = ia (c’). 


Hence tfa (d1) =”. Therefore fa*(d.) € H*(Va) represents c€ H*(f(b)). 
Thus c is the image under the homomorphism H*(b) > H*(f*(b)) of the 
element of H*(b) represented by d, € H*(D.). . 


642 EYUNG WHAN KWUN AND FRANK RAYMOND. 


3. Proof of Theorem 2. For each b€ BdY, there exists an arbitrarily 
small connected neighborhood U such that U —Bd F, UM.BdY are connected 
orientable gms [6, Lemma 2.2]. For such a U, take V—f*(U). 


Consider the following commutative diagram 


; 
Hr(U) ——> H»(U — Bd Y) 
[+ |r 
i 
H?(V) —— Hr(V — B4 X) 
By [8, Theorem 6, p. 40] i and j are isomorphisms. Since f’* is, an 
isomorphism [5], f* also is. By passing to the direct limit we obtain 
He (f> (b)) =H» (b) 


‘ 4 Proof of Theorem 3. (1) If X44, one can show that 
fa: Ha (X) > H,(Y) 


is an isomorphism. In fact, (1) of Theorem 3 is true if fẹ is an isomorphism 
as just stated. 
As in Théorème 7.9, p. 510 of [3], let é= A7 (1), 1€ H*(X), and # 
be the one corresponding to Y. Then f,(é)=—= +g. In the diagram 
A. 
He( Y) —— H, (Y) 
(i) | i fe 


1 


HR) —> By 4°(Z) 


A’, A71f* = + identity, where At, A’ are inverses of the Poincaré duality 
isomorphisms. This fact follows from the fact that A', (A’*), are obtained 
by capping (see [3]) with 6, (#), and f, )=+f. Thus f* in (i) is a 
splitting monomorphism and f, is a splitting epimorphism. 
(2) Consider the following commutative diagram 
dt l s2 4* a* 


> HP*(A) —> HPZ — A) > HR) > H(A) > HZ) 
(i) es ie |r Ir | [Ir 


: ree i* g* 
— HP (B) — B? (Y — B) —> H r(Y) — H ?}(B)— HP” (Y — B) > 
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where the rows are exact and f” =f | A, f —f | X— A. We have just seen 
that f* is a splitting monomorphism. ‘Furthermore, f’* is an isomorphism. 
Hence, if Hp (B) 0, then d? is trivial in dimension p. - Thus for p> 1, 
the sequence 

7% 4* 


J 
0> HP (X —A) — He (X) —HP(A)>0 


is exact, and j’* is an isomorphism. Since j*/’*;/’*-+—=—=/*, the sequence 
5 * 
0> A? (Y)— HY (X) —> H,®(A) 3 0 
splits, p > 1. 


For p= 1, 1’* and d* are trivial. We claim kernel j* = f’* (kernel j’*). 
This follows because f* is a monomorphism and f’* an isomorphism. We can 


„art the diagram (ii) into the two diagrams 
\ “* 


0 H,'(X — A) /kernel j* > H,'(X) —> H; (4) 30 
|i # |r 


0 -> Ht (Y —B)/kernel 7}* >H} (Y) — 0 
and , 
d* 
0> H,°(X) > H,°(A) —> kernel jt > 0 


f* f* fir 
0> H,(Y) > H,°(B) — kernel j’* > 0. 
The homomorphism f,’* is induced by f’* and is an isomorphism. Since the 


rows are exact, it is easily seen that Imi* ts the cokernel of f*. The five 
lemma implies that f”* is an isomorphism in the second of the two diagrams. 


(3) Consider the diagram (ii) once again. H?(Y) =H #(Y) —0, 


p30, n. The five lemma then implies that f/’*: H,?(B) > H(A) is an 
isomorphism for all p. 


Remark. The homology analogue of (2) is the splitting of the exact 
sequence 


jefe je 
> 07) es aE) oes o(X,X¥—A) 0, for p £0. 


Here f¢ (jefe ja") is the identity and the homomorphisms are just the 
duals to those in cohomology. One can prove this by replacing diagram (ii) 


12 
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by its homology analogue and copying the argument with a slight difficulty 
for p==1 which is overcome by a similar argument as used for cohomology 
at p==1. However, much more satisfying is to consider both diagrams and 
the isomorphisms between them induced by Poincaré duality [8; 6.2]. What 
must be shown is that this three dimensional diagram commutes (or anti- 
commutes). This is done by a that the isomorphisms are induced’ by 
cap products. 

If instead of compact supports we used closed supports and assumed X 
and Y paracompact then we would, by the same argument, be able to prove 
an analogous theorem in terms‘of closed supports. 

We leave to the reader the details of the proofs of Ga 1-4. 
We mention, however, that in the proof of. Corollary.1 one observes that 
‘H,*(X) ~H*(X) is finitely generated for each dimension and that any 
finitely generated module over a principal ideal domain cannot be isomorphic 
to a proper factor module. 


5. Proof of Theorem 4. (a) First suppose m > s. We have 
H, (Y, Y —y) =0, for all pss. 


The map fx”: Hp (X, X —f*(¥)) > H,*(Y, Y —y) is an isomorphism, for 
ull p=s and is onto in dimension s +1. Poincaré duality [8; 6.1] implies 
that Z&(F(y))=0, for k=-n,n—1,---,n—s. But, if n—sSs+1, 
f is acyclic, since acyclic maps cannot raise dimension, we are forced to 
conclude that either m—n and f is acyclic or else f is not acyclic and m & s8. 
In case we only had assumed n—s<s-+2, we could have trouble when 
n= 2s -4-2 in dimension s+ 1. However it isn’t hard to check ign that. 
either f is acyclic or m—=s+1<n. 


(b) We saw in (a) that if f is not acyclic then ms if n < 2s + 2, and 
mSs+lifnen2s+2. If ms, then Hy°(Y,¥—y) = H*(f(y)) —0, 
for k < m, and H™"(f*(y)) =L. On the other hand, Hy.) (F, Y — yo) 
=H (f*(yo)), if n— (s +1) Ss, or equivalently if nS2s-+1. There- 
fore we have shown that m -+ (s+1)=n. It remains to check the case 
n—=?s+2 and mss. However, if H,,,°(X) =0, we get a contradiction 
implying that no such f can exist in this case. 

Notice that the Leray sheaf of the map f is 0 in all dimensions except 
s+ 1 and there it is constant isomorphic to L. Nevertheless examples easily 
show that f(y) need not be generalized manifolds. 

In dimensions p—1, 2, 3, and 4, the bounds by s give the best possible 
results for mappings SP— Srk k > 0. 
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6. Proof of Theorem 5. In diagram 5.1 of 81 we have from (2) of 
Theorem 3 that the top row splits. From the remarks following the ‘proof 
of .Theorem 3 we have (using closed supports) that the bottom row of (5.1) 
splits Furthermore the first. rectangle defines the splitting and is cummu- 
tative. Obviously there is only one way to define y so that the diagram is 
commutative. Furthermore y preserves the pai un and must be 
an isomorphism. 


. Remark. For a compact set A one always has Hr(A) = ea H(A’), 
H,,(4) = at, n-p(A’), where A’ denotes a connected component ‘of A and 


the sum and oiia runs over the components of A. In Theorem 5, Hr(A) 
and H,»(A) are finitely generated, and therefore both representations are 
direct sums. Furthermore, f maps the components. A’ of A onto the com- 
ponents of B in a 1:1-fashion. Therefore the isomorphism y induced by 
f splits naturally into the direct product (sam) of the isomorphisms 
part Hral A) > H(A’). 


7. Manifolds which are smash products. In this section, we include 
‚a heretofore unpublished result of F. Raymond which serves as an illustration 
of Theorems 3 and 5. In view of its independent interest, we give a proof. 

The smash product (or reduced join) X A Y of spaces X and Y is the 
product XXY modulo gX YUXYX yY, zeX, y€ Y. Strictly speaking, 
therefore, X, Y, should be based spaces. However the choice of base points is 
irrelevant to our theorem and therefore will be ignored. We will assume F 
is & connected n— gm and Y =A AB, where dim A, dimB>0. Then the 
compactness of A and B follows from the local compactness of Y. 


_ THEOREM 6. Let Y=A NB be a connected paracompact n— gm, 
(n>0), and homology locally. connected in the sense .of singular homology 
(hlc). Then A is a k— gm, B is an (n—k)— gm and A, B and Y are 
all spherelike. 


COROLLARY. If F, A, and B are locally euchdean, they are all homotopy 
spheres. 


Proof. Denote by y the image point of AXbUaX B, a€ A, DEB, 
under the decomposition map f:AXB>AAB. The map f| (A—a) 
x (Beso). is a an an s0 


(U—a) X (B—b) U (4—a) X (V—2) 
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is a deleted neighborhood of y in Y, where U is a neighborhood of a in A and 
V a neighborhood of b in B. Since Y is locally orientable, y is contained 
in some orientable neighborhood. Using [6; Theorem 6] it follows that 
(A—a), (B—b), is a connected orientable k— gm, ((n—k) — gm). Since 
Y —y is orientable Y must be orientable. Furthermore, since Y is compact, 
the end cohomology groups J*>(Y—y) = H*(S"*) by [7]. From [752.2] 
it follows that the identity map induces an isomorphism 


i: He (Y —y) > H°(Y), p30, n. 


In order to establish the theorem for an arbitrary principal ideal domain 
it will suffice to prove the theorem for an arbitrary field of coefficients as may 
be justified by a forthcoming paper of one of the authors. Assume L is a 
field. It follows that Y —y has finitely generated cohomology with compact 
or closed supports. (See [7; p. 959]). This implies that both factors 
(A—a) and (B—b) of (Y—y) have finitely generated cohomology. We 
wish to use the Kiinneth theorem for both compact and closed supports. The 
Kiinneth theorem is valid for compact supports and is valid for ordinary 
singular cohomology when the cohomology is finitely generated. But Y is hic 
and so both A— u and B—b are also Alc. The sheaf theoretic and singular 
cohomologies agree for any paracompactifying family. Y is actually metri- 
zable by the paracompact and Alc assumption and so in particular Y —y is 
paracompact. We write the isomorphisms i as the isomorphisms 

air: 2 Hs(4—a) 8 H,!(B—b) > > H*(A —a) @ H'(B—b) 
a+t=p 


att=p 


where p>£0,n. The naturality of this isomorphism forces the k— gm A—a 
and the (n—k)— gm B—b to have trivial compact cohomology except in 
the top dimensions, (the homomorphism H,*(A — a) > H*(A —a) is trivial). 

In particular, 4—a, B—b and therefore Y—y all must have trivial 
cohomology with closed supports. By [7; 4.7], A and B and F are all sphere- 
like gms. 


Remarks. Conversely, if A and B are spherelike gms then Y—y 
== (A —a) X (B—b) is an acyclic gm. By [7], Y, the one point compacti- 
fication of Y —y, must be a gm (and in fact sphere-like). 

In the theorem if A, B or F is of dimension <2, then it must be an 
actual sphere of that dimension. Now assume that A and B have the same 
homotopy type as a C—W complex (true if A and B are ANR’s) and 
L = Z, the integers. Then F is simply connected (see for example [9; 3.16]) 
and therefore has the homotopy type of an actual sphere. Furthermore, one 
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can show that A and B also have the same homotopy type as spheres if one 
assumes, when dimensions are = 3, that the local fundamental groups at the 
base points are trivial. Hence, in conclusion we can say that the classical 
construction 


f 
SEX Sak ——» Sk A IE G” 


uniquely characterizes, modulo the Poincaré conjecture, the construction 


f 
AXB—AAB=-Y 


if A, B and Y are all locally euclidean. 


‘Also, it is not difficult to give examples where Y is a sphere but A and 
B fail to be locally euclidean. 


8. Remarks on factors of cubes. We like to take this opportunity to 
make some remarks on our earlier work: “ Factors of cubes,” American Journal 
of Mathematics, vol. 84 (1962), pp. 433-440, which will be hereafter referred 
to as FC. 

Question 1 of [FC; p. 437] has been neatly solved in the affirmative by 
Jehpill Kim of Seoul National University, in a paper to appear. It is shown 
in [FC] that for each n> 8, there-exist spaces A, B which are not manifolds 
with boundary such that A X B == I". We have conjectured [FC, the last 
sentence of Section 2, p. 487] that it is possible for n—6 and 7. The 
following theorem, which incidentally supersedes Theorem 2 of [FC], proves 
this conjecture and also answers the second half of oer 2 [FC, p. 437] 
in the affirmative: 


THEOREM 7. Let a C Intl”, 8 C IntI” be arcs and I"/a, I*/B respec- 
tively denote the spaces obtained from I” and I by shrinking a and B to a 
point. Then I™/a X 1*/B = I***, for all m, n= 2. 


We first prove a lemma in which the following notation will be used. 
Let f: I">I"/a be the natural projection. For any homeomorphism 
h: 8*—> 8, let f X h: I" X 8” — I*/a X 8” be the map such that (fX h)(a, 5) 
— (F(a), A (b)). 

Lemma. For any positive integer n, and homeomorphism h: : > Ss, 


there exists a homeomorphism g of I™X 8* onto I" Ja X 8” such that 
g | (Ba I= X 8") = (f | Ba I=) X h. 
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Proof. We use induction on n. .For n == 1, it is essentially the same as 
(2) of the proof of Theorem 2 of [FC]. Precisely, there exists a continuous 
map f 


- onto 
H: Im xt I” x §2 


such that » | (BdJ™ X S+) —=1 and EUR point inverses under » are piesis 
those of i 
4x 1.10% SE In/a x St. 


Then g = (f X 1)u" gives a homeomorphism of I" X S! onto I"/a x S* such 
that g’ |(BdI™ x St) =f X1. Let g= (1 Xh)g’. 

We now suppose the lemma is true for n—1>1, and prove it for n. 

Let §*=— D,UD,, where D, and D; are n-cubes such that Bd D, = Bd D.. 

There exists a homeomorphism ` l 

; onto , 

l . (g/t ™ X Bd D,-———> I" /a X Bd D.. 
such that = 

g | (Bå I" X Bd D1) — (f | Bd”) X1 


Consider the homeomorphisms 


1 


E onto - l 
fı==f | BAI” X 1: BAI” X Dı Bd (I™/a) XD. 


fı=g' on BAI" X Bà D, = Bà I” X Bd Da. 


Hence there exist homeomorphisms 
onto 
9: BA(I™ X Di) ———> Bd (I*/a X D;) 
such that l i 
`g | (Ba I® X Di) = fi 


Now, by Theorem 2 of [FC], as n=2, I"/aX D, and I™/&à X D; are 
“ + 0) cells. Hence g; can be extended to homeomorphisms 


gi: 1% x D> Ir /a xD 


Since gi | (I= X Bd D;) are both g’, they give rise to a homeomorphism f 


onto , 
g”: m X e—a xX 8 000 


such that g” | Bdl™ X S" = (f | Ba Im x 8") X 1. Set jax (1x h)g’ to 
obtain the desired homeomorphism. 
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To prove the theorem let 
oo. fi: 2 I"/a 
fa: I" I*/B 
be the projections and i 
fi: BAI" Bd(I”/a) 

fe’: BaIT” => Bd(I"/£) 


be their restrictions. We will prove that 
(1) Int(1"/a X I*/g) = Ee 
(2), In/a x In/ß is a manifold with boundary and 
(3) BdU"/aX I*/p) — gan, 


Since (1) and (2) imply that I"/a X T/g can be inbedded i in euclidean 
(m -+n)-space, E", our. theorem follows as in [FC]. 


(1) is proved in a paper by one of the authors: “ Product of Euclidean 
spaces modulo an arc,” to appear in Annaks of Mathematics. 


(2) It suffices to check each point of Bd(I™/a X I*/ß) has a “nice” 
neighborhood. Suppose v€ Bd(I"/a) X I*/ß. Then, using Theorem 2 of 
[FC], it has a neighborhood homeomorphic to I™ X I*/B—=I"'*, Similarly 
for y € I™/a X Bd(I*/B). 


(3) BAa(I™/a X Ir/B) = Bd(I"/a) X I"/B U I/a X BA(I*/8). 


By the lemma, there exists homeomorphisms 


onto 
gi: Bd I” X I" ————> Bd (I"/a) X I*/B 


such that g, | Bd" X Bdl* =f,’ X fx? and 


onto 
g2: I" X Bd I" ———> I" /a X Bd (I*/B) 


such that gs | BAI” X Bd I" =f,’ x fy. Hence g, and ga combine to give a 
homeomorphism of Bd(/® X Ir) onto Bd(I"/a X I*/B). i 
FLORIDA STATE UNIVERSITY 


AND 
UNIVERSITY OF MICHIGAN. 
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THE CLOSURE OF TRANSLATES IN Ir. 


By D. J. Newman. 


1, Introduction. Let f(z) have an absolutely convergent fourier 
series, and let P(x) range over the set of trigonometric polynomials. What 
is the closure of the functions P(x)f(z) in the P norm? In particular 
when is it al lof Ir? 

This ‘problem, the so-called ‘closure of translates problem,’ has been 
considered by various authors. Wiener (see [9]) treated the cases p = 1 and 
p=? and proved 


(1.1) For p= 1, this closure is all of V if 8, the set of zeros of f(x), 
is empty. 

(1.2) For p==2, this closure is all of l? if S has measure 0. 

The converses of (1.1) and (1.2) are also true. 

For other p, 1p 2, Beurling (see [1]) proved? 


(1.3) The closure is all of if S has Hausdorff dimension less than 
2(p—1)/p. 

In the case of (1.3), however, the converse is not true. Indeed it is 
‘not difficult to produce a set S of Hausdorff dimension 1 which nevertheless 
has the aforementioned closure property for all p> 1. (See our Corollary 2 
‘to Theorem 4.) 

In Section 2 of this paper we reinvestigate the case of l= p2 and 
-obtain some results which are in a sense both stronger and weaker than the 
Beurling theorem. Section 3 is concerned with the case ?<p<w. (The 
‘surprising result in this connection is that there are sets, S, of positive 
‘measure for which, nevertheless, the closure is all of P). Finally, Section 4 
‘treats the case p==oo, properly modified, and the necessary and sufficient 
condition is obtained. (It is simply that S be nowhere dense). 
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? Actually Beurling worked with Z? rather than P, but the distinction is not vital. 
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Definitions and basic notions. For 1S p<, } is defined to be the 
Banach space of sequences {Cn}, 0 <<, normed by - 


Headey. 


If f(z) is a summable function (on [0, Qr)) we say that f(x) EP or 
f(x) is an P. function if its Fourier coefficients, {cn}, are in IP. In this case 
we understand || f(z) |, to mean || {cs} I»- 

- We say that f(x) is Lip 1 if f(x) has period 27 and if there exists an 
M>\|f(x)—f(y)|SM|c—y| for all z, y. Note that for Pzp PDP 
and that, in particular, all the P spaces contain F. 

The space 7, when thought of as the space of functions with absolutely 
convergent fourier series, is actually a Banach algebra. 

If I is any closed ideal in I, we denote by S: the set of common zeros 
of the functions of J. We will make frequent use of the following: 


Lemma 1. If f(x) is Lip 1 and f(z) —=0 for all ze &;.then me el. 
For proof see e.g. [6] or [7]. 
Now let S be a closed subset of [0, 27). 


‚We call S a p-spanning-set if every closed ideal Z in V with: ums is 
dense in Pr. 


Leama 2. S is a p-spanning-set if and only if there exist Lip 1 func- 
tions fı(2), fe(£),; ©- each vanishing on 8, such that 


I fx(z) —1 |p 0. 


‚Proof. If-I is any closed ideal in I with 8;—S then, by Lemma 1, 
I contains all the functions P(x)f,(z), P(x) any trigonometric polynomial. 
Since | P(z)f,(¢) — Piz) ||, 0 it follows that the Ir closure of I contains 
all the trigonometric polynomials and, since the polynomials are dense in P, 
so is I. : i 
Conversely choose Z as the 7! closure of all Lip 1 functions:which vanish 
on 8. If § is a p-spanning-set then I is dense in /?, and so the Lip 1 functions 
vanishing on 8 are dense in P. In particular the constant function, 1, is is an 
limit of such functions. 
For the concepts of Hausdorff dimension and Hausdorff a-measure we 
refer the reader to [5]. 
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The space l°? is defined as the Banach space of all bounded sequences, 
{on} 0 <n <0, normed by || {c4} a= Sup |o]. 

We also introduce l”, defined as the closed subspace of J” consisting of 
all sequences {c,} with üm m. 


lo” can also be ought fot as the closure of the polynomials under the 
i? norm. 
Finally, by a triangle function, we mean & fonction of the form 


0 outside (£— ô, é -+ 8) 
. f(z) = Bo |2—£1/) inside («—8,&-+ 8) 


where 0 <t—3 <@+8S 2r, f(z) having period 2m. h is called the height 
and 28 the base of f(z). 


The Fourier coefficients of f(z) are 
2h > =, nn 
md n u 
2. The case 1Sp=2. One of the defects of Beurling’s theorem is 
that it does not reduce to Wiener’s theorem when p==2. ‚Thus while Wiener 
only requires that S be of measure 0, Beurling demands that J have Hausdorff 
dimension less than 1. 


In terms of Hausdorff a-measures, Beurling’s result may be stated as 
follows. 


(2.1) Lf the a-measure of S is 0 for some a < pP— then the closure 


is all of P. 
One wonders whether this can be replaced by 


(2. 2) If the a-measure of S is 0 for a2 EZ P tie the closure is 


all d pP. 

This is an attractive conjecture and indeed would contain (1.1), (1.2); 
and (1.3) as special cases. We are, unfortunately, unable ms decide whether 
(2.2) is true or not. 

The usual tool, however, for deciding whether the «-measure of a set is 
0 is the following implication. er 

‘Let 8 be a closed subset of [0, 2x] and let (a; 5), (anl ba) (a, bn) 
be its complementary intervals arranged in non-increasing order of lengths. 


Call T, = 2r — $ (by — a). 
ei 
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(2.3) If lim nvr, = 0, then S has a-measure 0. 


For @==1, the converse is also true. 


~ Notice, however, that there are in fact denumerable sets $ for which ra 
goes to 0 arbitrarily slowly so that (2.3) is strictly a one way implication. 
Nevertheless for the usual ‘Cantor-like’ sets the condition is. both necessary 
and sufficient and we adopt the following: 


Definition. § is said to have strong a-measure 0 if el 


THeorem 1. Lee lSpS2, a2 ae 1 fe) ei wads suppose that the 
set, 8, of zeros of f(x), has strong a-measure 0. Then the set of multiples, 
P(z)f(z), of f(x) by trigonometric polynomials is dense in P. 

This theorem, just as Beurling’s, does not of course express a nasc. 
Nevertheless it is best possible, just as is Beurling’s, in that it becomes false 
if eis replaced by any larger number. See Salem [8], whose examples 
actually have strong a-measures 0. : 

Before we turn to the proof we wish to state a slight generalization. 


THEOREM 2. Leb l1<pS2,a—m2 G-n. If 8 has strong a-measure 
0 then S is a p-spanning set. ` j 


Q/p)-(/3) 
a f any absolutely continuous 





Ifl 
Imoa 8. esa [14 il 


function, A being an absolute constant. 


Proof. Writing f(x) -5 06t", we note that this lemma reduces to a 
pure inequality for infinite series, namely | 


(1) En PSA (S| YA St On aer 


Setting $ | C, |? = r°, Sin? | C, |? —c*y*, allows us to rewrite (1) as 
s nel = #=1 


(2) S | Oy P £ Aarh, 
2 a=1 
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We establish (2) by obtaining the bound zry!/? for both 2 Ou.|? and 
E | Ca |P. 
n>y 
(3) E| Cn PS (E |O |) (ZIS (a8) Pye PP. 
a5 "Sy 
S| Cx [P= Sn? | Cy |? 1/n? S (Zn? | 0p |?)7/*- (inset) +a! 
(4) Sy n>y n>y >y 
< (x2y?)?/2-A z (412012-0) 1-9/3 am APY, 
(3) and (4) yield (2) and the proof is complete. 
Now choose an n for which rẹ, < en'-1/¢, define p(z) — == distance from x 
to the complement of u (ar, by) and finally set 
& (2) — Max[1 —n¥% (2) /e, 0] 


LEMMA 4. || S(s) ||, 427, 
Proof. Direct application of Lemma 3. We have 


1E la £ [SP (2) de} (rn 4+ ne nti) £ V Be nia, 


| © ha S (f(x) de) S (Bn: n/c) im V2/e ni, 
Hence, by Lemma 3, ' 
| & lo = A (ente) 2-1/2p (n/a Je)" am A&P, 


The functions 1—®(z) are Lip 1 and vanish on 8, so that an immediate 
application of Lemma 2 proves Theorem 2. 

We now wish to prove a theorem which complements some result of Salem 
(see [8]). Namely we exploit the connection between closure properties 
in and existence of functionals in the conjugate space 17. (Compare Herz 


[4]). 


THEOREM 3. Let S have strong B-measure 0, and let du be a non-trivial 
measure whose support lies in 8, then S| f eedp |38 =o. 


Proof. Suppose the series converged so that the Fourier-Stieltjes coeffi- 
cients of dy were IP, then L{f) = f{fd» would be a non-trivial bounded 
linear functional on [*/?-8. But, since the support of dp lies in S, L annihilates 
the ideal of all I functions vanishing in S. Applying Theorem 2 with 
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‘p= 2/2 — B, then, we find that L annihilates a dense subset of 12/28: ı This 
contradicts the fact that Z is non-trivial and.the proof is complete. = >= 

We now give another kind of condition on sets, 8, which insures that they 
be p-spanning sets, this condition being related to the notion of a ‘base.’ 


Definition. We say that S is a base of order k if the set k xS, ofal 
numbers of the form +2 +: 2% with each 2; € 8, has positive measure. 


$ 


We say that-S is a base if S is-a base of order k for some k., 


THEOREM 4. If S is not a base of order k and if PRUE then 
Sisa p-spanning-set. 


Leaving aside the proof of Theotem 4, fer the moment, we wich first. to 
draw some corollaries. In particular, one trivial consequence is . 


COROLLARY 1. If’S is not a base, then S ts a p-spanning-set for all p>. 


This leads to the following construction: Let K denote the set of all 
integers in the intervals [2*,2*(1-++1/k)]. Now define 8 to be-the set of all 
numbers © such that the m-th binary digit of z is 0 for all me K.: 8 is 
obviously not a- base since no amount of ‘carrying’ can fill up the blocks of 
0’s, that is to say if the ne 9 then zn +: -2, still has its m-th binary 
digit 0 for all m with pee torre —n, and so the es ‘of the 
numbers z,-++- * -Tẹ has measure 0.. 

Now consider the set 8, constructed in the same way with the ‘tara 
[2*, 2*(1+-¢)]. Clearly Se can be completely covered by a finite number of 
translates of the set $ (Indeed if the intervals of K corresponding to k < 1/e 
are deleted, then the resulting set covers Se). 

It is a simple exercise, however, to show that the a of Pe is 
1—e 2 
1 





We may sum up these observations in 


Goxortany 2. There exists a set of dimenston 1, which is a p-spanning- 

set for all p>1. 

Finally we give the 
3 ae 7 Spanning-set, then . 
‘we can find an ideal J with S= S, and a bounded rina functional, L, 
on PC- which annihilates J and is such-that L(1) —1. 

“Reference [6] gives a representation formula for all such functionals L, 
and this may be put in the SERIE" form: 


Proof of Theorem 4. Suppose that 8 is not a ———- 
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Lemma 5. There exists a summable function B(x) with &’(x) =1 for 
all «¢ S, such. that, for all trigonometric polynomials, P(z), 


ay ar 

E MPEs f Pete) + P(e) le. 
57 

Im. 

Sine, in our present case, L is a bounded linear functional on #402- 
it follows that {Z(e"*)}¢ 1% Thus if {c,} are the fourier coefficients of 
(x), then 
(5) Z| ney | <o. 


If ®** denotes the result of convolving ® with itself k times then ®** 
has fourier coefficients {c,*} and so (5) tells us that the k-th derivative, 
(&**)®, exists almost everywhere as an L? function with fourier coefficients 
(inc,)*}. It follows, in particular, that 


(6) The mean value of (®**)®) is 0. 
The statement (6) will now be contradicted by the following 


Lemma 6. If mSk, then (SF) m —1 for allagm XS. [In particu- 
lar (®**)® — 1 a.e.] 


Proof. Induction on m. By Lemma 5 it holds for m==1. Suppose 


that it holds for m—J1, and that m k. [Also note that all the m X 8 are 
closed sets of measure 0.] 


Now 
(7) fl (2—1) o*n- (t)di 


Let Z, Za, Is, © - denote the complementary intervals to (m— 1) X S. Since 
(m— 1) X S has measure 0, (7) may be rewritten as 


(8) an(s) — a (z — t) D0- (2) dt 


Let z vary over a fixed interval, I, in the complement of m X S. Formal 
differentiation of (8) leads to 


(9) (an(s) Mm i f la) (arm) dt 
T yale lp 
and since r— té g this in turn is equal, term by term, to 


1 $ 7 
2 1-1 dl. 


v=1./1y, 
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This latter series, of course, converges uniformly over the in eval, I, 
and so the formal differentiation is justified. Since the series cc’ rges to 
1 we conclude that os 

(*" (co) me 1 for all zE J, wh 
and since J was arbitrary, the induction is complete. 

This proves Theorem 4. 


Before closing this section we wish to point out that Theorem 4 includes 


This fact rests on the 





2h 
2k—1 
simple observation that a set having strong 1/k-measure 0 is automatically 
not a base of order k. 
By contrast we mention the famous example, due to Eggleston (see [2]), 
of a set of Hausdorff dimension 0 which is in fact a base of order 2. 


Theorem 2 for those p of the special form 


8. The case o>p>2. The search for p-spanning-sets in this case 
seems extremely difficult and we cannot at present even match the question- 
able precision of the last section. There are, however, two or us AIRY 
trivial observations we can make at the outset. 


3.1. A set of 0 measure is a p-spanning-set for any p> 2. - 
3.2. <A set containing an interval is not a p-spanning set for any p. 


3.3. A set, S, is a p-spanning-set if and only if S supports no non- 
trivial function in l@ (here, as always, q denotes the conjugate 


TEPA ; aP 
index to p, i.e. q Peer Jie 


Clearly 3.33.1. Again, since any interval supports a ‘triangle’ 
function (which is in fact in 7+), we see that 3.33.2. Thus we need 
only give the (standard duality) argument which proves 3.3. 

So let Z be a closed ideal in !!. Once again, by Lemma 1, J contains 
all Lip 1 functions vanishing on S, and so it contains a single function G(s) 
whose set of zeros is precisely S. . 

Now suppose that L is non-trivial bounded linear function on P which 
annihilates J. We know that ()*—=I« and this tells us that there exists a 


2 
non-trivial f(z) € 77 such that L(g) -Í "g(«)f (2) dz for all gel. Thus 
0 


ir 2: 
Í g(z)f(z)dr=0 for all gEI and in particular f er (a)f(r)da—0 
a 0 
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—_ 


for allt It follows that G(x) f(z) —0, and this is precisely the statement 
that sh hports f(x). Conversely, if S supports a non-trivial function 
f(z)€1 en the functional defined by : 


ifa g(z)f(z)dz for all gel! extends to a non-trivial bounded 
linear $. ";ional on Į which annihilates I. 
These two remarks, of course, complete the proof of 3. 3. 
We see, then, that our present problem is equivalent to what, in more 


common Fourier series language, might be termed the uniqueness problem 
for l4 series. Let us make the following 


Definition. We call a closed set S an 1¢-multiplicity-set if there exist 
{cn} not all 0 such that X | ca i <œ and such that $, cet"? converges ® to 0 
for all z€ 8. 

Any closed set which is not an I-multiplieity-set we call an /@-uniqueness- 
set. a 
In terms.of this definition, 3.3 becomes 


3.4. A set is a p-spanning-set if and only if it is an l@-uniqueness set. 


The main results of this section state that there exist p-spanning-sets 
of positive measure, but that sets which are a “well-packed’ are not 
p-spanning-sets. 


THEOREM 5. Let p>2,a<2r. There exist p-spanning-sets which have 
measure > a. 


Our next theorem involves the same considerations as were made in 
Section 2. Namely: If 9 is a closed set, let (a1, 61), (da, 52),- - + denote its 
complementary intervals arranged in non-increasing order of length. 


This time call R,($) == 2 (ba). 


In general R,(8) > 0 and the rate at which it does so expresses how 
‘well packed’ the set 9 is (If, for example, S consists of finitely many 
intervals, then &,(8) is eventually equal to 0.). 


THEOREM 6. Let p>2, B>p/2—I1, 8 be a closed set of positive 
measure. If R,(S) =0„P then S is not a p-spanning-set. 
*If f(v) is a summable function which vanishes on an open set, then its Fourier 


series converges to 0 on that set. This is simply the observation that convergence is a 
local property. 


13 


660 . D, I.-NEWMAN.: _ 


The preceding theorem is unimprovable, at least for p=4, in that it 
becomes false if p/2— 1 is replaced by any smaller number. [This will be 
shown at the conclusion of the proof of Theorem 5.] 


Theorems 5:and 6 also have ‘dual’ statements which we can express via 
3.4. These are the following: 


THEOREM 6’. Let 1<q<2, a<r. There exist It-uniqueness-sets 
which have measure > a. ' 


Teworsm 6. Let 1< q<2. If S is a closed set of positive measure 
and tf Ry(S) = Oyf for some B > Z 





—4 then 8 is an 1%-multiplicity-set. 


We will prove Theorems 5 and 6’, both in a fairly constructive way. 
Ineed, in order to-establish Theorem 6’ we will actually prove 


ears vY. Letl<q< 2. If 8 is a closed set for whichR,(S) = 0%, 





with B> 7 , then the “characteristic function? of Sis an la function. 


It will prove useful for us to digress a bit with the following number- 
theoretic considerations, which may also be of independent interest. 

Let K be a set of k integers (mod N) and denote by r(n) =r(n;K;N) 
the number of distinct solutions to the congruence 


n=s-+t(modN),seK,teK. 


Now if k= N, so that K consists of all the integers (mod N) the value 
of r(n) is constantly equal to N, independent of the value of n. On the other 
hand, as some results of Erdös and Turán (see [3]) show, if & is of the same 
order as. (or-of lower order than) VN, then, whatever the set K, r(n) must 
be ‘significantly’ non-constant. We shall prove, however, that if k is at all 
of higher order than VN, then a K exists which makes r(n) ame constant. 

The preeise statement follows. 


LEMMA 7. There exists a set, K, having k elements, and for which 


1 N ‘ S Eu 2 
rn = < ace 
van) c)? 5c, where c =F: 
[In particular if k is large compared to VN then r RA) has a standard 
deviation which is small compared to its mean.] 
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Proof. First note that 


Flo ag Ao 
atian k 


so that the required inequality can be written as 
(10) (E) S/N 4+ ök 


N 
where (K) is an abbreviation for $ r? (n). 
n=l 


Next observe that 


(11) E-S SRE Z i= D 1 
A n=l 8,two0eK stuveR 


en sıtzumEn etz 
Ar l N EOS 
If we now form $, »(K), the sum ranging over all the ( k ) sets K having 
K 


precisely k elements, we obtain, from (11), 


(12) ZulK)— 2 Ss i= = 2 1 
R S &huveK 1,40 alk 
è ettu atta stuweK 


The above inner sum is obviously equal to E PO 7) where t i is the number 


of distinct numbers among s t, u,v (iS 4). Thus if we denote by à; the 
number of quadruples s, £, u, v for which exactly i of them are distinct and 
for which s+ t==u +v we obtain 

i 


. 4 N—i.. 
(13) Ze(K) =2A( ki} 
K H 
Next a straight forward counting procedure gives 
For N even: Ay== N, Ma == 2N*—N, às = 2N? — 4N, M= N? — 4N? + 4N 
For N odd: Ay: N, Ag 2N? 2N, Àg = 2N? 2N, Ay =N’ — 4N? + 3N. 

















All we need retain, however, are the inequalities 
ME Nk, M SNP, nZS2N®/k, MENS, 
together with the obvious inequality 
A) s ami) 


‘and we can conclude that 
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Sa) S (Cy NEE + 2N (E/N) 42T (E/N) N (E/N) 
= GO [ok + E/N]. | 
It follows, then, that for at least one of these sets K, . 
w(K) Skt/N + 5%, 
And this is exactly the required inequality (10). 
We can now translate this lemma into a result on a trigonometric sum. 


LEMMA 8. There exists a set K containing exactly k integers in [1,N] 
for which 


N-1 
E | P(o*) |* 5%N, where P(t) — 3 t, o = et, 
= sek 


Proof. Choose the set K given by the previous lemma. 
We have 


N N N N N 
3 | P(or) PE | E r(m)om PN E rm). 


N No. 
But, by Lemma 7, $ 7° (m) S/N + 5k?. Thus >| P(o*)|*S kt -+ 5N 
m=L 1 
; N-1 3 : { 
so that > | P(or) |< 5%°N as required. 
n=l 
In terms of this polynomial, P, we define a function F(x) by 
F(z) = 3 cotra 
where u = P(w")/k((sinan/N)/(an/N))?, Co being interpreted as 1. 
We will now establish the following four properties of F(z). 
(14) F(a) ie Lip 1 


(15) The support of F(s) has measure dr 
(16) | F(z) +1 lp S 2NR for all p, 2S p S4 
(17) || F(z) —1 |p SNK, for p= 4. 


The function F (x) is easily recognized as the sum of k triangle functions 
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each with base Ar/N and height N/k. Thus (14) and (15) follow imme- 
diately and (16) is established for p—=2. 

By Minkowski’s inequality we observe that | G pS | G ef? || G | 
so that (16) need only be established for p—4. In this case the inequality 


states that 3 | cn |*<8N/#. 
n=1 


Since 0 for n a multiple of N, we have 
Salm E (Joel + ower +E | craw E> =) 
SUE (P(A A/a H1 (2) 41/82) 4 +) 
S85 E | Plo) 8% 


(the last inequality following by Lemma 8). This proves (16). 
Finally observe that || =1, so that, for p>4, 


UFE) 1 ip)” — Ss] on PSB [en |S 16% 
ny0 ny0 
and (17) also follows. 


Tt is clear now, that an appropriate choice of N and k supplies the proof 
of the folowing l 


Lemma 9. Letp>?2,e>0. There extsts a Lip 1 function F(s) whose 
support has measure < e and for which | F(z) —1 |p <€. 


We are now in a position to give the 


Proof of Theorem 6. Choose eı,&,&,' °° to be positive numbers for 
which $ e & r — a. 


For each & we choose the corresponding F(s) given by Lemma 9. 


Calling this function F(s) and its set of zeros S; we choose S = [} Si 


Clearly the S, and so also S are closed sets. Also, since m(S;) > ee it 
follows that m(S) >2r—Sa2a. But Lemma 9 tells us that Fy(x) is 
Lip 1, vanishes on 8, and | #:(7)—1]p—0. An application of Lemma 2 
completes the proof. 

It is now fairly clear why, for p=4, Theorem 6 is best possible. Let 
us simply be more explicit in our choice of the k, N, 8; etc. above. Indeed 
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let 0 < y < p/2—1 and choose k= 2i, N = 20 for j ==-jo, jo + 1; * 
By (15) and (16) this choice works. But thus the complementary ink 
of S are introduced 2/ at a time having lengths 442-(*), and it follows that 
Ra (8) = On. 


Finally we present the in 

Proof of Theorem Y. We prove instead that the characteristic function 
of T, the complement of S, is le. Let Ty be the union of the first N com- 
plementary intervals and let {a,(N)}, {bn(N)}, {cx} denote respectively the 
fourier coefficients of the characteristic functions of Ty, T— Ty T. 
(18) Sr Ca mi Om + bu | l 

Since, by hypothesis, m(T—Ty) £ AN-, we may add 
(19) > | 6, |? SAN, 

To estimate the m We now prove 


Lemma 10. If a(z) is the characteristic Junot of the union of- N 


intervals, {an} are the fourier coeficients. of & (2), and 5 is any positive. integer 
then 


om SN. 
ee 


Proof. 


_ By Parseval’s theorem we have 





(20) 45 | ay |? in? if Jeta) —0(0) de, 


Now ®(2 + 1/2/) — 0(z) except possibly in 2N intervals of length a2, 
so that (20) becomes 


(21) 43 |a, |*sin? =~ < Ng, 


QF = 








Also, for 27 |n| <2), sin sin? I = 4 and the result follows. Combining 


(18), (19) and Lemma 10, we obtain 
| es [PS A (N8 + NZ) 


e Ks 


or setting N == [24/8], 


| Cn |? A2- IBNR, 
sachin 
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and an application of Minkowski’s inequality gives 





(22 nn a< AB u 
CIR = on 





2841 
Bu 
ar 


we obtain - 








9? 





Elele <o, 
and the proof is complete. f 


4, The case p= œ. This situation requires certain modifications before 
a feasible problem can be realized. 1” is not a separable space and so, in 
particular, the trigonometric polynomials are not dense. Again the closure 
of translates of a single [* function can never be dense, and in fact this closure 
contains only series whose coefficients 0. These ills are all remedied by 
considering, instead of J”, its subspace l°”. 

In this case the necessary and sufficient condition that S be a spanning 
set is simply that $ contain no intervals. 

We will actually prove somewhat more. Indeed let {c4} € lo”, we denote 
by the translates of {c,} all the sequences {d,} where for some integer k, 
dy = Cask, and we say that the translates en lo” if the linear combinations 
of these {d,} are dense in l”. 


TEEOREM 8. The nn of {cn} span 1” if and only if there is a 


dense subset of (0,27) on which the formal series 5 meine fails to converge * 
to 0. 


Proof. The following two statements are equivalent for {c„} € Io” 
(23) > caet"? converges to 0 throughout (a,b) 


sin ae 


(24) Èo CR -)2et" == 0 throughout (a -+ «e, b— e) for every «, 





Indeed this is the starting point for Riemann’s theory of trigonometrie 
series (see [10]). 


!We mean by the statement ‘ 2 a, converges to 8’ that lim 3 Oy = 8. 
Noo -N 
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Suppose then that our formal series $, c„e’"= did converge to 0 in some 


interval (a,b). Thus the same is true for Sidye"e where {d,} is any trans- 
late of {c„}. By (24), then, the bounded linear functional, L, defined by 


. b—a 
sinn 
L({an}) =Da,f ___°_ a 





5 
annihilates all translates of {c,} so that the translates of {¢,} do. not span h”. 


Conversely if the translates of {cs} do not span I,” then there exist 
non-trivial bounded linear functionals which annihilate the translates of {cy}. 
But (l° )*= l}, and the totality of such functionals is thus a closed ideal, 
I, in F. Let (a,b) be an interval which does not intersect Sz. For any é, « 


with £€ (a+6¢,b—e), 0 << TE, the function 
aa FSD? \s,-intgin 
Fa) I Vetter 


is a triangle function supported entirely in (a,b). Thus f(z) € I by Lemma 
1 and so the corresponding linear functional Z, annihilates {c,}. This means 
that Zero.) so that. (24) is verified. ‘Thus (23) holds, 
which means that 3 aetre converges to 0 throughout the interval (a,b). 
The proof is complete. 
The same proof extends to give 


THEOREM 9. Let 3 be a closed translation invariant subspace of h”. 
ö is a proper subspace if and only if there exists an interval (a,b), 


O0<a<b< r, such that $ cett? converges to O for all sE (a,b) and 
all {cy} € 8. 
As a corollary to this theorem we have 


COROLLARY. Let 8 be a closed set containing no intervals and choose 
any e>0. There easts a C® function which is equal to 1 throughout 8 
and whose fourier coefficients all have moduli less than e. (If S contained an 
interval this would no longer be true). 
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Proof. Let f(z) =D cnetre be a C” function which vanishes precisely 
on S. By Theorem 8, the translates of {c,} span the sequence {èno} and 
this means exactly that, for some trigonometric. polynomial, P(x), the func- 
tion 1—P(z)f(x) is small in the l” norm. Since this norm is the maxi- 
mum of the moduli of the fourier coefficients, the function 1—P(z)f(z) 
serves to prove the corollary. 

An explicit constructive. proof of this corollary seems very difficult to 
give. If it could be given, however, it might shed considerable light on the 
spanning problem for p > 2. 
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TWO FUNDAMENTAL THEOREMS ON DEFORMATIONS. OF. r 
POLARIZED VARIETIES. i pi 


- „By T. Marsusaxa and D. MUMFORD:+ .- 


Introduction. In contrast to the theory of moduli of curves, the global 
theory of moduli ‘of higher dimensional varieties—with the exception of 
Abelian varieties —is largely unexplored. The work of the authors and ‘of 
others? has begun at least to clarify the problem, and to pose some “plausible 
conjectures. One :thing that is clear, however, is that there is 4 complexity 
here of a higher order of magnitude from that encountered for curves. The 
purpose of the present article is to present two results of a qualitative nature 
that limit the degree of possible complexity of various sought for varieties ‘or, 
scheme of moduli. The first result of ours asserts that two non-singular 
projective varieties: with polarizations,.which are isomorphic’ as polarized 
varieties, remain : ‘isomorphic after specializations over a discrete’ valuation- 
ring, whenever they remain non-singular ‘polarized varieties and at least” one 
of ‘them is non-ruled (cf. Th. 2). The second asserts that ‘a set of non- 
singular: ‘polarized surfaces, which are deformations of each “other, * can be 
realized as an algebraic family (ie a finite union of an irreducible algebraic 
family) of non-singular projective surfaces in a projective space, if “their 
ranks are bounded; and, in fact, the set of non-singular surfaces with non- 
degenerate divisors with a given Hilbert polynomial and of any. ‘characteristic 
can be realized-as an algebraic family over the ring of integers. From this, 
it can be shown that the variety of moduli of such ‘surfaces, which are not 
ruled; is a finite union of Q-varieties, which will be discussed in a near-future. 

. In Chapter I, we shall settle the first result we mentioned. In Chapter II, 
we give an estimation for 1(X).when X is a non-degenerate divisor on-a pro- 
jective variety. Our second main theorem will be settled in Chapter III, as 
well as in Chapter IV, under slightly different technique. In the first -three 
Chapters, essentially. the terminonolgy and conventions of Weil’s book [18] 
are followed. In Chapter IV, because of the nature of the an which 
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are followed, essentially Grothendieck’s terminology and conventions in [2] 
are followed.: : However, in order to keep the uniformity, the word “ample” 
(resp. “ non-degenerate”). is used for “very ample”. (resp. “ample”) in the 
sense of Grothendieck. i - 

By a specialization of a variety or a cycle, we understand a reduction of 
such over a discrete valuation-ring (cf. [17]). For the theorem of Riemann- 
Roch in general, we follow quite often the sheaf-theoretic terminology which 
can be found in [15] and [22]. Let V be a normal variety and M a finitely 
generated module of functions on V. When Finfgem(div(g)), the set 
A(M) of. V-divisors div(g)— Y, g€ M, is called the reduced linear system 
determined by Af. When F is any positive V-divisor, A(M) -+F is called a 
linear system. Assume that V is complete. When X is a V-divisor, the set 
L(X) of functions g on V such that div(g) +X >0 forms a finite dimen- 
sional vector space ([18], App. 1, Th. 3). We denote by A(X) the set of 
positive V-divisors which are linearly equivalent to X, and call it the complete 
linear system determined by X. We denote by |X| the support of X. We 
have A(X) =A(L(X)) +F, where F =X +infyeum(div(g)). We denote 
by 1(X) the dimension of L(X). When V is a projective variety, we denote 
by oy the sheaf of local rings on V, the defining sheaf of functions on a scheme 
V. If X is a Cartier divisor on V, we denote by 2(X) the corresponding 
invertible sheaf. With this sheaf theoretic notations, H°(V,2(X)) —L(X) 
when V is normal. Moreover, when V is a non-singular projective surface, 
IP?(V,2(X)) is isomorphic to the dual of H°(V,2(K(V)—X)) and 
dim H1(V,2(X)) =s(X) is the superabundance of X. When there is no 
danger of confusion, we write H‘(2(X)) for H*#(V,2(X)). 


Chapter I. 


' Tuxorea 1.8 Let V be a complete abstract variety, W- an abstract 
variety and T a birational correspondence between V and W. Let o be a 
discrete valuation-ring with the quotient field k, such that V, W and T are 
defined over k. Let (V’, W’,T’) be a specialization of (v, W,T) over o and 
assume that V’, W’ are abstract varieties and that V’ is complete. When W’ 
ts not a ruled variety, there is a component T” of T’ with the coeficient 1 
in T’ such that T” is a birational correspondence between V’ and W’ and 
that pr(T”— T”) =0 for +—1,2. 


Proof. ‘From the compatibility of specializations with the operation of 
algebraic projéction (cf. [17]), we see that 7’ has a component 7” with the 


° This theorem was pionted out to us by M. Artin. 
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following properties: (a) pra T” = W’; (b) the coefficient of T” in T” is 1; 
(c) pre(T”— T”) =0. Let p be the maximal ideal of o and « the residue 
field of o with respect to p. Let (2’) be a generic point of a representative 
of W’ over x. Then, there is a representative (z) of a generic point of W 
over k such that (2’) is a specialization of (x) over o, over 


0 
(V, W, T) ——> (V, W’, T’) 
(ef. [17], Th. 7). Let R, be the specialization-ring of the ‘specialization 


(x) ees (z’) in k(z). Then R, is a discrete valuation ring of k(x) (cf. 
[17], Prop. 5 and Th. 15). Hence, it determines a valuation y of k(z). 
Let Q X (x) be a generic point of T over k. Since V and V” are complete, 
there is at least one representative (y) of Q such that the coordinates y; of 
(y) are.in Rẹ that (y’) is a representative of Q’ if “(Q X (2), (y)) 


oO. 
—— (Q’ X (2’),y’)) and that Q’X (2’) is contained in |7’|. When 
that is so, Q’ X(x’) is contained in T”; in fact, it is a generic point of p” 
` since pra: T” —> W’ is birational and (2’) is a generic point of W’ over x. It 
follows that Q” is a generic point of the projection A of T” on V’ over x. Let 


R be the specialization ring of (y) er (y’). Then, the valuation v is a 
prime divisor of R in the sense of Abhyankar, and W” is a ruled variety over 
A unless A = V’ (cf. [1], Prop. 3). Therefore, A = V’. When that is so, 
T” is a birational correspondence between V’ and W’, which can be seen easily, 
using the compatibility of specializations with the operation: of: intersection- 
product (ef. [17]).. 


THEOREM 2. Let o be a discrete valuation-ring with the quotient field k; 
let V and W be non-singular projective varieties, defined over k, and T the 
graph of an isomorphism, defined over k, between V and W. Let X (resp. Y) 
be a non-degenerate divisor on V (resp. W), both rational over k, such that 


Ye=uT(X). Let (V,W, 4%, ¥, rT) ——> (V’, W, X’, Y’, T’) and assume that 
V’, W’ are non-singular and that X’ (resp. Y’) is also non-degenerate on V’ 
(resp. W’). Then T’ ts the graph of an isomorphism between V’ and W’, 
if one of the V’, W’ is not ruled. 


Proof. By Theorem 1, we have T’— T” + T*, where T” is a birational 
correspondence between V’ and W’, and pr, T* =O fori=1,2. Let Fi,:--, Fi 
be the projections of the components of T* on V’. Note that, none of the F, 
is 0-dimensional: for if F; were 0-dimensional, the corresponding component 
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of the n-dimensional cycle T* would have to be of the form F; X W’, and this 
contradicts pr, T* = 0. If X’„ is a divisor in A(mX’), then T” and X’m X W’ 
intersect properly if and only if | X’,| DF; for any i Let U be the set 
of such divisors X’m. For every such X’'m 7’(X’„) is defined. The Chow- 
variety of U, i.e. the set of Chow-points of members of U, is an open subset 
of that of A(T’(X’„)). When U is not empty, the mapping X’, > T” (Xm) 
defines, as is well-known, an injection of U into A(T’(X’n)); and, as a 
matter of fact, defines an injective linear rational map of the Chow variety of U 
into that of A(7’(X’„)) cf. [18], Chap. IX, Th. 3 and [18], Chap. VIII, 
Th. 4). Now assume that (a) 7’(X’m)~ mY’ and (b) I(mX’) =1(mY’) 
for large ‚m. 

Suppose that P’ is a point of V’ and let A(mX”)» be the linear sub- 
system of divisors which pass through P’. For sufficiently large m, mX’ is 
ample, hence P’ is the only base point of A(mX’)p, hence A(mX’)p- NU is 
not empty. Then the set A of divisors T” (Z), Z’€ A(mX’)p- NT, consists 
of divisors passing through every point Q’ such that P’xQ’e€|7’|. Lf 
there were more than one such Q’, the closure of the Chow-variety of A is at 
least of co-dimension 2 in that of A(mY’), since mY’ is ample for sufficiently 
large m. On the other hand, its co-dimension has to be 1 as the closure of 
_ the image of the Chow-variety of A(mX’)p NU by the injective rational 

map, since 1(mX’) =<=-I(mY’). Hence T* =—0 and 7” is single-valued on the 
‚points of V”, hence everywhere regular by Zariski’s Main Theorem. Similarly 
T’-! is everywhere regular. l 
‚To prove (a) and (b), note that pg(mX) = pa(mY) for all integers m. 
Hence pa( V”) — pa(V) = pa(W) = pa( W’); and po(mX’) — pa(mX) — pa(m¥) 
— pa( mY’) for all integers m (ef. [18]). It follows that (mX) =l(mY) 
= 1(mX’) = 1(mY’) for large positive integer m by the theorem of Riemann- 
Roch (ef. [21]). Thus (b) is satisfied. Now let C and D be the supports 
of the Chow-varieties of A(mX), A(mY). Since the linear equivalence is 
preserved under specializations (cf. [17]), C’, D’ will be the supports of the 


Chow-varieties of A(m2X’), A(mY’) for large m, if CDs (œ, D’). 
Then (a) follows from the compatibility of specializations with the operation 
of intersection-product and from the invariance of linear equivalence under 
specializations. l i 

Let V and V’ be two complete non-singular polarized varieties (cf. [20]), 
k a field of definition of V and o a discrete valuation ring with the quotient 
field k. Let X be a polar divisor of W and W, W’ the underlying varieties 


0 
of V, V. If (W,X) —— (W’,X’) and X’ is a polar divisor of V’, we 
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shall say that V’ is a specialization of V over o. With this definition, de have 
the following corollary. 


CoRoLLARY 1. Let V and W be two varieties over a discrete valuation 
ring o (i.e. p-variety in the sense of Shimura; a scheme in the sense of 
Grothendieck). Let generic fibres V, W of V, W be non-singular projective 
varieties, defined over the quotient field k of o. Let the special fibres V’, W’ 
be non-singular projective varieties. Assume that V, W, V’, W’ are underlying 


We nak o 
varieties of polarized varieties V, W, V’,.W’ and that (V, W) —— (V’, W’) 


can be extended to (F, Ws (V',W’). Then, when there is an iso- 
morphism f between V and W over k, f can be extended to an isomorphism Í 
of V and W, if W’ is not ruled. Moreover, the graph of f specializes to. tre 
graph of an isomorphism f’ between V’ and W’ over o. 


COROLLARY 2. Let V be a projective, non-ruled, non-singular variety 
with a structure of polarization and G the connected component, containing 
the identity, of the group of automorphisms of V. Then G is an Abelian 
variety. 


Proof. The group of automorphisms of V is an algebraic group (cf. [8]). 
If- G is not complete, the graph of an automorphism, corresponding to a 
suitable element of G, can be specialized, over some field of definition of V, 
to a V X V-eycle which is not the graph of an automorphism. This. is 
impossible’ by Theorem 2. Hence @ is complete and is an Abelian variety 
by the theorem of Chevalley (cf. [19], Th. 5). 


Chapter II. 


Let V” be a normal projective variety and X a non-degenerate divisor 
on V. L(mX) defines a projective embedding fm of V for large m by the 
definition. Let Wr be a simple subvariety of V and k a common field of 
‘definition for W and V, over which X is rational. Then L(mX) has a 
basis over & (cf. [18], Ch. IX, Cor. 1 of Th. 8). Let A,‘ - -, Ay be inde- 
pendent generic divisors of A(mX) over k. Then every component of 
WOA,N:-+: A, is simple on V and on W (cf. [18], Ch. V, Th. 1). 
We set [W XO] = (1/m")deg(W-A,---A,) and YO=[V-XM]. Then 
[W:X] does not depend upon the choice of independent generic ‘divisors 
As >, Arn Moreover, it does not depend upon the choice of m, as long 
as it is sufficiently large, and is a positive integer (cf. Bezout’s theorem). 
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THEOREM 3. Let V» be a normal projective variety and X a non- 
degenerate divisor on V. Then (X) SX +n. 


Proof. If 1(X) 1, there is nothing to prove. If n==1, our theorem 
is an immediate consequence of the theorem of Riemann- Roch. Therefore, 
we assume that /(X) > 1 and that n> I. Let X, be a generic divisor.of the 


complete linear system A(X 7 Then X= È+, where F is the fixed 


component of A(X) and F4 Y; for 1 j, since A(X) is complete (cf. [18], 
Ch. IX, Cor. of Th. 15). If'd> 1, the F, are generic divisors of one and 
the same pencil on V by the theorem of Bertini (cf. [18], Ch. IX, Th. 17). 
Hence dimA(X)—=I(X)—1=d. On the other hand, we get dS X™ by 


d 
computing X™® — [($ YF; + F) X]. Therefore, our theorem. is true in 
1 


this case also. 

Assume now that d—1. Then &,—Z-+F, where Z is an absolutely 
irreducible subvariety of V. Let K be an algebraically closed field, containing 
k, over which Z and F are rational, and (Z*,a) a normalization of Z over K. 
Let My be a positive integer such that mZ is ample for m= m, and Xm a 
generic divisor of A(mX) over K for such m. We note that every com- 
ponent of Xm N Z is simple both on V and Z and is proper on V. We contend 
that: (a) When ge L(Xma—Xm), g—> g? egoatisa homomorphism of 
L(Xmi—Xm) into L(X*), where X* =a (Z; (Xmii— Xm) ) 3 (b) The kernel 
of the above homomorphism is a vector space of dimension 1; (c) X* is non- 
degenerate on Z* and X*0-) < X), Our theorem will be an immediate 
consequence of (a), (b), (c). For, we have 1(X*) < X*@-) + (n—1) 
by the induction hypothesis, hence 1(X*) SX™ -+ (n—1) by (c), and 
U(X) = (Xm —Zm) SUX*)+1 by (a) and (b). 

To prove (a), we.may assume that g* 40. We first remark the following 
two facts: (i) If U is a subvariety of Z of co-dimension 1, which is simple 
both on V and Z, and g’ is the function induced on Z by g, then the coefficient 
of U in div(g)-Z, that of U in div(g’) and that of «(U) in div(g*) all 
coincide; (ii) If W* is a component of div (g*)o =g (œ), its geometric 
image W by o^ is a component of Xmun N Z, and is simple both on V and Z. 
In fact, U has the same coefficient a in div (g) -Z as in div(g’) (ef. [18]-IX, 
Th. 3). Since g* can be written as g'o at, and since a is biregular along E 
it follows that the coefficient of “(U) in div(g*) is also a. As for (ii), g 
is not finite along W* (i.e. at a generic point of W* over a field of definition 
of W*, containing K), and hence, g is not also finite along W. k 
WC |gi(æ)|= | Xm | and. W is a component of ZN Zaun. 
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: Now let U be a component of Xm N Z or of Xma N Z.. Since 
div (g) Z +Z- (Kna— Xu) >0, 


it tollon? that the coefficient of a (U) in div(g*) + X* is N by (i). 
Therefore, if div( g*) -++ X* has a component W* of negative coefficient, it is 
a component of div(g*).=g*"(co), which is impossible by (i). 

To prove (b), let g be a function in L(Xmu— Xm) such that g* == 0. 
Then. div(g) = W— (Xmiir— Xm), Where W is a positive V-divisor such 
that Z is a component of it. Since W ~ Xmu — Im Z, it follows that ` 
W=Z-+F and that g is uniquely determined up to a constant factor. 
(b) is thereby proved. 

To prove (c), choose a positive integer r= m, and identity A(rX ) with 
the linear system of hyperplane sections of V by means of the embedding fr 
Let s be another large positive integer. Then sX, —srX 1 —srX„ and sX,, 
Km, STX m are sections of V by hypersurfaces of degrees s, sm, s(m-+1) 
respectively, since the linear system of hypersurface sections of a normal pro-' 
jective variety is complete when the degree. of hypersurfaces is large enough 
(Zariski’s normalization theorem). Consequently, sX, Z, srX&m' Z, rm" Z 
are also sections of Z by hypersurfaces of degrees s, sm, s(m-H1). When 8 
is chosen large enough so that a is determined by homogeneous functions of 
homogenity s, a(sX,:Z), a(srXm-Z), «(srXm41) are hypersurface sections 
of Z* by hypersurfaces of degrees 1, m, m -+ 1 respectively. Hence 


t 


aX Zj ~sra(Z- (Zan Inj): 


‘Thus, X* =a (Z: (Xmı—Xm)) is non-degenerate. A(rX) is the linear 
system of hyperplane sections of V. Hence ` 

ZO) = (1/em2)deg(X) — (1/r)deg(Z + F) > (1/3) deg(Z). 
A(srX*) is the linear system of hyperplane sections of Z*, Hence ¥*0-3 
== (1/(sr)"™*)deg(Z*). But deg(Z*) een) as is well- known and 
easy to see. (c):is thus Dre - 


‘Remark 1. Let Q be a non-degenerate invertible sheaf (ample invertible 
sheaf in the sense of Grothendieck) on a projective variety V. Let d be the 
leading coefficient of x(2"). Then it is easy to deduce that dim H°(2) 
= d+ dim V from our theorem. In fact, when (V*, 8) is a normalization of 
V and X a Cartier divisor on V* determined by &, then X is non-degenerate 
and d= X™ if dim V* =n, 


g Remark 2. In our theorem, we assumed that x is 'non- degenerate: 
Assume now that V is a non-singular projective surface and X a V-divisor 


m 
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such that X® > 0 and [Y-X]> 0 for all positive V-divisors Y. Then, we 
can prove directly that (X) SX®O +2. In fact, we may assume, as. in 
the proof of our theorem, that a generic divisor X, of A(X) is of the form 
Z+ F, where Z is an irreducible curve. Let Y be a V-divisor such that 
Y ~X and that | Y | contains neither Z nor any singular point of Z. Then 
[X-Z]—[¥-Z]<X® and L(X) and L(Y) are isomorphic. As in the 
proof of our theorem, L(Y) induces on Z a module M’ of functions on Z; 
a(M’) is then a submodule of M*—L(a*(Z-7)) and the kernel of 
the homomorphism L(Y) — M* is a vector space of dimension 1. Hence, 
we have our inequality by the theorem of Riemann-Roch. Our divisor X is 
in fact a non-degenerate divisor on V according to [12], and our theorem 
is available according to this. But using this remark and our ‘Theorem 4, 
we recover this result. 


Chapter III. 


Let V be a non-singular projective surface and X, Y two divisors. There 
is a V-divisor X’ such that X’~X and that X’ and F intersect properly 
on V. We denote by XAY the intersection-product X’: Y, and by [X-F] 
the degree of X,Y. When XY =F, [X-X] is denoted by X®. We denote by 
K(V) a canonical divisor on V and set po(X) = (1/2)[X: (X + K(V))] +1. 
When X is irreducible, (X + K(V)),X is a canonical divisor K(X) of X 
and deg(K(X)) —2p.(X) —2 (ef. [16]). When Z = dak, we have 


(1) Pa(X) =È apa (Xs) +2 (1/2) (u — 1) X,@ 
| + 2 (1/2)aa[X, Xj] —La—1. 
455 O45 i l 
According to the theorem of Riemann-Roch on V, we have 


X) —s(X) +E (7) —X) = XO — pa(X) + pa(7) +2. - 

1. Denote by X the set of pairs (V,X) of a projective non-singular 

surface V and a V-divisor X satisfying the following conditions. 
(I) [X-7]> 0 whenever Y is a positive V-divisor; 
(II) 0< XM <a; 

(III) | pa(X)| < cs; 

(IV) | pa(V)| <a. 
In order to simplify further discussions, we assume that the constants ci 
(i> 8) which will be introduced are positive integers, satisfying c> Cii 
and depending only upon cı, Ca, Ca. 


14 
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Lemma 1. There are constants c,, cs such that |[X-K(V)]|<c% and 
that pa(mX) > 0, KK(V) —mX) = 0, m2 XO —pa(mX) + po(V) +1>0 
whenever (V, X) €Z and m > cs. 


This is an easy consequence of (I), (II), (III), (IV), the theorem of 
Riemann-Roch and of the formula (1). 


t 
Lemma 2. Let (V,X) be a member of % and T =£ uY, the reduced 
1 
expression for a member T of A(2c,X). Then, there are constants Ce, Cr, Cs 
and c, with the following properties: 
t 
(i) Ea< c; 4 
(ii) Ir) <a; 


(ii) [LK (V) MI < 0850S pa(¥s) < cs; 
(iv) The multiplicity of any point on Y; is at most cp. 


t t 5 
Proof. (i) is a consequence of Fa Sa [Y;:-X] = [TX] S Recs. 
1 $ 
(ii) and (iii) follow from the three inequalities : 
(A) uY + Eyl Ye Y] — [Yi 2X] S Daly: eX] S 457. 
tyhj 


(B) —2S2p.(¥.) —2— [Fr (Kit K(V))I]. 
(C) Salk (V) Yi] S exes. 


In fact, (A) gives an upper bound for every Y;®. Hence, (B) gives a lower 
bound for every [K(VY)-Y;]. Then (C) gives an upper bound for every 
[K(V)-¥4] and (iii) is proved. Returning to (B), we obtain a lower 
bound for every Y,®, and using this, (A) gives upper bounds for all [Y,- Y,]. 
This gives (ii), since [Y;-Yj;] 20 if i}. Finally, the arithmetic genus 
of Y; is bounded by (ii) and (iii). If the ry are the multiplicities of the 
singular points a, of Y;, an inequality of Noether (cf. [4]) states 


Bruty + 1)/2 + pa(Ye*) S pal¥s), 
where Y;* is a non-singular model of Y;. This gives (iv). 


The following lemma is an easy consequence of the generalized Riemann- 
Roch theorem for curves. 


Lemus 3. Let W be a non-singular surface in a projective space and 
Y a divisor on W. Let C be an irreducible curve on W such that [Y-C] 
> 2pe(C) —2. Then H(2(¥)/2(¥ —C)) —0. 
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ÜOROLLARY. Using the same assumptions and notations of our lemma, 
8(¥ —C) —s(Y) if and only if 
0> H(2(¥ —C)) 9 HUT) > A°(2(Y)/2(¥ —C)) 3 0. 


Proof. This is an immediate consequence of our lemma and of an exact 
sequence 0-> L(Y —C) >L(Y) ~&(F)/2(Y —C) 0. 


Lemma 4 Let T= Sa, be a positive divisor on a non-singular pro- 
i 


jective variety W, A(A) a complete linear system on W and assume that 
[(4 — T): Fi] > 2pa(Y:) —2 for all i and for all T’ such that 0 < T’< T. 
Then we have H*(8(A)/2(A—T)) =0. 


Proof. If $ a= 1, our lemma follows from Lemma 3. Assume that 
our lemma bas on proved for those positive W-divisors T” == $ aY, with 
SaL Sa. Set T= Ery; with n — 1-0, ua; for cee. In the 
a Sokoro giii of an exact sequence 

0>KA— T) /R(A—T) > 2(A) /2(A —T) > 2(A)/2 (A ~—T’) > 0, 


we have H1(%(A)/2(A—T"’)) 0 by the induction assumption, and 
Ht (2(A—T’)/2(4—T)) =0 by our assumption and Lemma 3. Hence 
we get H*(2(A)/2(A—T)) =0. 


COROLLARY 1. Lei (V,X) be a member of X and T ==, uY; the 
j 4 
reduced expression for a member of A(2c3X). Set T’ == NY, U =X hY, 
4 i 
with 0<a, aia. Then, there is a constant ci, such that 


(2 (Imes X — U )/&(2mc; X — U —T’)) =0 
for m= tio. 


Proof. This follows at once from our lemma, (I) and from Lemma 2. 
COROLLARY 2. There ts a constant c such that 
Cy = 8(2me,.X) = 3(2(m + 1)cesăX —B) Ss(2(m+1)eX) 
whenever (V, X) € X, KRc, X —B) 21 and m Z to. 


Proof. This is an easy consequence of Theorem 3, Corollary 1 above 
and of Lemma 2. (cf. Remark 2.) 


COROLLARY 3. There is a constant cy, such that A(2me,X) ts irreducible 
(i.e. contains an irreducible curve) whenever (V, X) EX and m> ir 
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Proof. Let T bea member. of A(2c,X). If Y is a fixed component 

-of A(mT), we have (mT) =l(mT—FY). Then m[T -E]=s(mT—- Y) 
—s(mT) +-p4(¥)—1 by the theorem of Riemann-Roch, which leads- fto a 

contradiction if'm > max(¢io, 26u + cs — 1) = ĉn’ by the above Corollary 1, 

(I).:and by (ii) of Lemma 2. If A(mT) is aa aa of a pencil for 


m > Cx’, a generic divisor of A(mT) can be written as ÈT where the Tı 


belong to one and the same pencil by the theorem of Benini. ` Clearly, we 
a dim A(m2’) St and [Ti T] =1 by (I). Hence .(mT)®>.# and 
mis ar22 t= dimA(mT). On the other hand, - 


$ ` dim A (mT) S (2m?c,?e, — MCyC4) gs? 8 
‘by (I), Lemma 1 and by the theorem of Riemann-Roch. Our als, now 
follows from this easily. ; 


Re When A and X ‚are two linear systems on a complete nl variety, 
the smallest linear system A” containing the divisors X + X’, XEA, ar A’, 
is called the minimum sum of A and A’. Then ane following lemma | is easy 
to prove. 


Lemma 5. Let A(C) be a non-empty complete eee system o on a 
complete normal variety W. Assume that A(C) has no base point and that 
thé minimum sim of A(C) and A(mC) is complete. Let hy de a non- 
“degenerate map of W into a projective space determined by A(i0) ‘for 
t=m, m+1. Then there is an isomorphism a between smdiges Wen Yan 
-óf w by Tun, hm such that hmi = a 0 hm- in 


In the following three lemmas, denote by C an irreducible curve, on. a 
non-singular projective surface V and Ro the intersection of local rings of C 
at the singular points of C. Using only. those functions of C which are in Ru, 
we can define linear systems as in the case of normal varieties. Throughout 

- this ‘chapter, linear systems on curves lying on V are under stood in this sense. 
By the degree of a linear system on C, we understand the degree of a generic 
divisor of the linear system. The Riemann-Roch theorem on C. then states 

Km) = deg(m) —pa(C) +1+1(K(C)—m) for a C-divisor m (c£. [18], 
[16]). The following lemma is known as a lemma of Castelnuovo when C 
is non-singular, which can be proved in the same way as in the ordinary case. 


Lemma 6. Let A’ be a linear system on o without base point and A 
a complete, non-special linear system on C. Let w bea generic divisor of A’ 
and assume that’ A—1V is non-special and is of degree equal to ‘deg (A) 
—deg(n’). “Then'the minimum sum of A and A’ ts complete. — 
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Actually, it is enough to know a special case of this lemma, under an 
additional assumption that deg(A) — deg(n’) = 2p4(C), which makes a proof 
very easy. 

Let A be a linear system A(M) + F, where M is a finitely generated 
module of functions on V. Let C* be the largest non-singular open subset 
of C and denote by * the restriction of a C-chain (i.e. a zero-cycle on V 
whose support is contained in C) to C*. Assume that C and F intersect 
properly on V and that every g in M induces a function g in Re on C. 
Denote by A/’ the set of such functions g’ and by A’ the set of C-divisors 
(X-C)*+ (C-F)*, by taking for A all divisors from A(M) such that X 
and C intersect properly on V. Then A’ is a linear system on C, whose 
reduced part is determined by M’. We denote A’ by Tro A and call it the 
linear system on C induced by A. When A is a complete linear system A(T) 
whose fixed component F satisfies our requirement, it always induces a linear 
system on C, since there is a V-divisor Z such that X —Z and that the 
support of Z does not contain C and the singular points of C. 


Leamsa 7. Assume that C® >O and that A(C) has no base point. -If 
s(mC) is a constant for all positive integers m, the minimum sum of A(C) 
and A(mC) is complete for m> [C-K(V)] + 4.. 


Proof. Let C’ be a V-divisor such that C’~C and that | C’| contains 
neither C- nor the singular points of C: We have [C-(mC)]--2p,.(C) >0 
when m satisfies our condition. Hence Tre A(mC”) is complete by Corollary 
of Lemma 3. By our assumption, Trg. A(C’) has no base point. Hence the 
minimum sum of Tre A(mC’) and Tro A(C’) is complete for such m by 
Lemma 6. Thus, the minimum sum of A(mC’) and A(C’) induces on C a 
complete linear system. Let Af be the module generated by f-g with 
fe L(mC’), geL(C’). Then M induces on C the module L((m+1)C’:C). 

‘When A is a function in L((m+1)C’), inducing 0 on-C, we have div(h) 
=C+H—(m+1)C with H>0. Hence h is in M (cf. [18], Chap. IX, 
Cor. 2 of Th. 8). Our lemma follows from this at once. 

It is not true in general that a complete linear system A(m) on C con- 
tains a divisor of the same degree as m, unless m is positive. But we have 
the following. l 


Lema 8. When deg(m) = 2pa(C), Alm) contains a divisor of the 
same degree as m. l l 

Proof. Let a be a positive C-divisor such that deg(m) =deg(a) =m. 
Set pa(C) == l and let k be a field of definition for C over which m and a 
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are rational, Then, there are two generic divisors p and q of degrees t over 
k and a unit f in Re such that div(f) —(m—a) + (p—a) (ef. [14], 
Lemma 3). Since a is positive, a generic divisor of A(a) over k has the 
degree m; moreover, we have l(a) 2t+1. Therefore, there is a unit g in 
Ro and a generic divisor a’ = p+ b of A(a) of degree m such that div(g) 
=-q—a’, Then div(f-g)=m—g—b and our lemma is proved. 


3. THEOREM 4 There is a constant Cı, such that mX is ample for 
all (V,X)€ 3, whenever m > is. 


Proof. In order to prove our theorem, it is enough to prove that mY 
is ample for all (V,X) in 3%, where m, is a constant, depending only on c, 
Ce, Cs. In fact, the sum of two ample divisors is also ample; moreover, if Y 
is an ample divisor on a non-singular projective variety W and B == B’— B”, 
B’ > 0, B” > 0, is a W-divisor, then, whenever 


d = deg (B’) - (deg(W) —2) + deg(V) + deg(B”), 


dY +B is ample (cf. [18], Chap. IX, Cor:, Th. 13). Our theorem follows 
from these two facts and from Lemma 1 as an easy exercise. _ 

Let T be a member of A(2csX) and Z an irreducible member of A(¢,27’) 
(cf. Cor. 3 of Lemma 4). Then we have 


(a) [rZ (212 +HiT)] > 2pe(rZ) for 0< St and for all t20. In 
fact, this follows from (II), Lemma 1 and from the formula 2p,(D) —2 
=[D: (D+K(V))]. 


(b) There is a constant d, depending only on cı, Co, Ca, such that 
A(mdZ) has no base point for m= 1. In fact, there is an integer a such 
that 3 Sa Sc +3 and that s(aZ—— Z) —s(aZ) (cf. Cor. 2 of Lemma 4). 
Set r——-¢==1 in (a). Then we see that Trz A(uZ) is complete by Corollary 
of Lemma 3; moreover, it is of degree > 2p,(Z) since 8(aZ)/2(aZ—Z) is 
isomorphic to 2((aZ),Z). When that is so, A(aZ) has no base point by 
Lemma 8. 

Now let E be an irreducible member of A(dZ) (cf. Cor. 3 of Lemma 4). 
By Corollary 2 of Lemma 4, there is an integer b such that 3Sb<¢,,+3 
and that s(b#) ==s(bH—H). Trg A(#) has no base point by (b). By 
(a) and Corollary of Lemma 3, Trg A(b#) is complete and is of degree 
> 2pa(#). Moreover, TrgA(H#) and Trg A(b#) satisfy the conditions of 
Lemma 6 by (a) and (b). Therefore, the minimum sum of them is complete, 
-which implies that Tr; A(b#+ 2) is complete and s(bE + E) ==s(bF) 
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(cf. Cor. of Lemma 3). Repeating this, we see that s(cu#+3#H+m#) is 
a constant for all m= 1. By (I) and (b), a non-degenerate map hm of F 
into a ptojective space, determined by A(m(cı + 8)E), is a morphism and 
has no fundamental curve on V. Then it is a projective embedding for 
large m, which is an easy consequence of the possibility of projective nor- 
malization in an algebraic extension of the function field (cf. [7], Chap. IV, 
Prop. 8). Then Am is already a projective embedding if 


m> [en +3)E-K(P)]J +r 222 (eu + 8) dcızcsc;, + 4 


by Lemma 5 and Lemma 7. Our theorem is thereby proved. 


Chapter IV. 


So far, we have restricted our technique to the use of irreducible curves 
on the surface. Since the generalized Riemann-Roch theorem is available 
for such curves, it was easy to see, for instance, whether some linear systems 
on such curves are free from base points, etc. On the other hand, if we 
generalize a criterion of ampleness to reducible curves by means of the theory 
of schemes, we can simplify the latter part of Chapter III to some extent. 
Let V be a projective variety. Denote by Oy the sheaf of local rings on F. 
If D is a Cartier divisor on V, we mean by the associated subscheme ®© the 
subscheme of the scheme V (a) whose underlying space is the support of D 
and (b) whose sheaf Og is defined at a point 2 of D to be D,,r/(f) for any 
local equation f of the divisor D, where ,,1 is the local ring of V at x. We 
further denote by m.z,y the maximal ideal of O,v. In the following proposi- 
tion, we discuss a criterion of ampleness on a positive 1-cycle on V. The 
first half of the proposition has been settled essentially in Lemma 4, and we 
give only a brief account of the proof for it in the sheaf theoretic terminology. 


Proposirion. Lei Fasur ı be a posilive divisor on a non-singular 
projective surface W. Let r be the subscheme of the scheme W, associated 
to T, and M an invertible sheaf on r. Let d; be the degree of the Cartier 
divisor class on Y, defined by MOOy,. If h> [(K(W) +7") Ti) for all 
divisors T” such that 0< T’< T, and for all i such that 1SiSt, it follows 
that HM) = 0. Moreover, if di > [(K(W) + 7’) Yi] +2 max, «y, (multi- 
plicity of x on Y;), then W is ample on r. 


Proof. We have Or/&(— T) D7, Ow/2(—T’) =O, from the defi- 
nitions of Dr, Dr, where r’ is the subscheme of W, associated to T”. More- 
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over, we have @(—7’)/&(—T) =L— T) @Hy, when we use the same 
notations as in the proof of Lemma 4. Hence, we have the exact sequence: 


0>8(—7") @Dy, > D> Dr 3 0. 


Tensoring the above with W, we get 
H(MBOL— T) 8 Or) > H+ (MN) > HMI Or) > 0 


instead of 
I (Q(A— 1’) /Q(A—T)) > H (8(4)/2(4 —T))> 
> H1(2(A)/2R(A—T’)) > 


in the proof of Lemma 4. Computing the degree of the Cartier divisor class 
on F, determined by MOL(— T) 8 Or, we get H*(M) — 0 as in the proof 
of, Lemma 4. 

For an invertible sheaf X on a complete algebraic scheme W to be sense 
it is necessary and sufficient that: 


(i) the sections of X separate points, 


(*) (ii) for any point x on W, if we identify the stalk 2, with Dew, the 
sections of & which are zero at x span Ma, w/Me,w’.. 


For every point & in the support | T | of T, let Da be a positive W-divisor 
such that i(D,-Y,x2; V) gives the multiplicity of « on Y, for 1SiSt. 
Moreover, for every pair of distinct por x, y in |T|, define an invertible 
sheaf Mey on r as follows: 


Mey = MO L(— Da) in | T|—y—(|T|N| D.|—2), 
=MO@2(—D,) in |T|—2—(|T| | D,|—y), 
a= I elsewhere. 


Similarly, for every æ in |T I define Mae as follows: 


Me MO L(—2D,) in [TI—(T|o|D. |— 2), 
== Yt elsewhere. 


The first half of the proposition implies H* (Drey) = 0 for all the pairs (z, y), 
because the degree of the restriction of Wey to Y, is at least d,—2max 
(multiplicity of z on Y,). Therefore, we have the exact sequence 


wey, 


0> H? (Mey) > I (Qt). > H°(W/Ms,y) > A (May) = 0 
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for all pairs (2,4). Now supposex~y. Then H(M/M;,), whose support 
is the union of two points z and y, contains a section which is 0 at z and a 
unit at y. Hence H°(9t) contains a section with the same property. Then 
the sections of M separates points. Let f=0 be a local equation of D, 
at x, f being an element of O,w. Then f induces an element f in ©,,,, and 
we have (U/Mze)s=Oz2,7/f?. But this maps surjectively to the ring 
Dsr/Ma,r. Hence, if we identify M, to 02,7, the sections of M which are 
zero at © span M,,r/Ma,r. 

Using this proposition, we recover Corollary 1 and Corollary 2 of 
Lemma 4. Moreover, Corollary 1 can be expressed as H*(2(mX — U) 8 D.) 
== 0 for m ZÆ Cio where r is the subscheme of V, corresponding to a member 
T of A(2c,X). Furthermore, we see that 2(mX)®0O, is ample on r for 
m 2 Ci When Cio is chosen suitably. Then, by Corollary 2 of Lemma 4, 
one can find an integer r such that s(cu T rT) == s(c f +rT +T) and 
that OS rie. Set m—2e5(co+r+1). Since H1(L(mX) @O,) = (0) 
and s(mX) =s(mX — T), it follows that the restriction map H°(R(mX)) 
> H°(2(mX) ODr) is surjective. Moreover, Q(mX) ®O, is ample on r. 
To prove that 2(mX) is ample, we again use the criterion (*) cited above. 
Let z and y be two given points on V. Let T, and 7; be members of A (cX) 
such that T, goes through x and that T, goes through y (cf. Lemma 1). 
When we set T=T, + Ta, x and y are in the support of r. Since K(mX)®0- 
is ample, there is a section of this sheaf which is zero at x and not zero at y 
if «ey. Lifting this to a section of @(mX), the same is true of V(mX). 
If. s =y, set T =2T,. The restriction of functions from V to r induces an 
isomorphism between itts,y/Mas,r? and M,,r/iM.,r?. When we identify the stalk 
of 8(mX) OO, at z with D-r, the sections of &(mX) ® O, which vanish 
at £ span Mz,r/Mz,r°. Lifting these sections, we see that the same is true of 
Q(mX) and mer/Mz,r?. Hence &(mX) is ample for m= 2e,(c, +r+1), 
where r is a certain integer such that OXrc,. Since the sum of two 
ample divisors is ample, we see that 2(dX) is ample for a suitable d, which 
depends only on cı, C2, cs. Then we get our Theorem 4 again. 
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ON TANGENT BUNDLES OF FIBRE SPACES AND QUOTIENT 
SPACES. 


By R. H. SZOZARBA.* 


Introduction. One of the most important invariants associated with a 
differentiable . manifold is its tangent bundle. Indeed, the tangent bundle 
has been involved, directly or indirectly, in virtually all of the recent progress 
in differential topology. In spite of this, relatively little has been done toward 
the determination. of the tangent bundle of a given manifold or class of 
manifolds. (Two exceptions to this statement are Borel and Hirzebruch, 
[2], Proposition 7.5 and Wu, [12], p. 86.) In this paper, we investigate 
the tangent bundles of manifolds occurring in differentiable fiber bundles. 

The first section of the paper is devoted to the statements of the main 
theorems. Theorem 1.1 gives information about the tangent bundle of a 
quotient manifold X/G in terms of a G-equivariant embedding of the manifold 
X in Euclidean space. The second result, Theorem 1.2 describes the tangent 
bundle of the total space of a bundle with fiber F and group G in terms of 
a G-equivariant embedding of F in Euclidean space and Theorem 1.8 is a 

` combination of Theorems 1.1 and 1.2 applying to bundles with fibres X/G. 


The next two sections give applications. In Section 2, we apply Theorem 
1.1 to quaternionic projective spaces and, in Section 3, to manifolds of 
constant positive curvature. The remaining four sections give proofs of 
results stated in the first three sections. 

Finally, I would like to express my gratitude to W.. S. Massey and L. 
Auslander for many stimulating and informative conversations during the 
preparation of this paper. l 


1. The main theorem. Let ¢ be a fibre bundle* and suppose a group 
H acts on Hg and Bg with wg(ha) == hag(x) for se Eg heH. Then rg 
induces a map we’: E/H > Be/H and, under suitable circumstances, the triple 
(E/H, ze, Bz/H) is again a fiber bundle with fiber Fẹ and group Gg 3 


Received March 14, 1963. 

* During the preparation of this paper, the author was partially supported by 
NSF Grant No. NSF G-18996. 

1 We use the term fiber bundle to mean “espace fibré,” as defined in Cartan [3], 
exposé 6. Our notation is that of Borel-Hirzebruch [2]. 
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Lemma 4.1). Under these circumstances, we say that H acts on the bundle € 
and. denote the quotient bundle by ¢/H. 

‘Suppose M is a differentiable manifold. We will dance ‘the ape 
bundle of M by r(M) and the trivial r-plane bundle over M by 0 == 6"(M). 
If £ is a differentiable fiber bundle, we denote by rr(£) the bundle of vectors 
in r(Eg) tangent to fibers and by ri(é) the bundle of vectors in (Be) 
orthogonal to fibers (in some Riemannian. metric). 

Clearly r(H#z) is equivalent. to the Whitney sum rr(£) Br. and 
r1(€) = afr (Bẹ), the bundle over Fẹ ‘induced by me from r(Be). 

` For the remainder of this ‘section, all bundles will be differentiable. 

Suppose é is a principal bundle with Eg compact and let ¢: B> R” be 
an embedding which is equivariant relative to a representation a: Gg—>0 (n)2 
Giving Eg the Riemannian metric induced by ¢ and letting vg be the normal 
bundle of the embedding &, we see that Gg acts on both vg and'rp(£) as 
described above.. Now if a(£) denotes the n-plane bundle ‚associated. mu 
the a-extension of é (see [2], p. am), we have 


THEOREM 1.1. 
(Be) © rr(€)/Ge O vg/Gz = a (é). 


For example, suppose é== (8”,”, P,„(R)) is the. standard .Z,-bundle 
where S* is the n-sphere and P,(R) is n-dimensional real projective space. 
Then, the usual embedding ¢: S*—> R*+! is equivariant relative to the repre- 
sentation. a: Z,>0(n +1) which takes the non-zero element of Z, into the 
negative of the identity in 0(n-+-1). Thus by Theorem 1.1, 

ao r(Px(B)) © v4/Za—a(é). | 
Now, a(é) is easily seen to be the (n-++1)-fold Whitney sum of the line 
bundle € associated with € and »g/Z, is trivial since vg has a Z,-equivariant 
cross section. Therefore, we have the well known result? E 


r(P,(B)) B E= (n+ 1)È 


The analogous result for complex projective space follows in exactly the 
same way. 

Next, let £ be a principal bundle and suppose Ge acts (on the left) on 
a manifold F. Let ¢ be the associated bundle with fiber F and suppose 


2 Mostow [8] has shown that, if B; and Ge are a such embeddings always 
exist. See also Palais [9]. 
° This result and the analogue for complex projective space are proved by Milnor. 


in his notes on, characteristic classes pp. 10-12 and 74- me See also Atiyah [1], Lemma 
4:5, ° 
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y: F->R* is embedding which is equivariant relative to a representation 
B: Gg>0(n). Now, since E; = Eg Xa; F and, Fee) = He Xe; R”, y induces, 
an embedding ¢: B:> Es 


‘THEOREM 1.2. 
rd) ® » ale. 


To illustrate, suppose £ is a principal 0(n)-bundle, é the adaki 
vector bundle, and ¿ the associated sphere bundle. The usual embedding 
y: St C Re is O(n)-equivariant and, since vy has an 0(n)-equivariant cross 
section, the normal bundle of the induced embedding $: Er- Bẹ is u) 

seen to be-trivial. Thus, 
rel) BO = até 


where 6! is the trivial line bundle over Fẹ (see Wu [12], p. 86). 


Now suppose é and y are principal bundles and suppose @¢ acts on En 
with (ge)g’—=g(zg’) for gE Ge g’E Gy, and ze Hy. Then, Ge acts on By 
and we can form the bundles é with fiber En, éa with fiber By associated 
with € Furthermore, the map 1 X r: EX E- EX B induces maps 


ay: He X By — E; X, Ban = Egy 
m3: Eg X a, Eq = Eg Ee Xa, By == Be, 


and the triples é, =— (Eg X En, 71, Ba), Co = (Hg, 72, Ex) are principal bundles. 
(& is a principal Gg X Gy bundle and £, a principal Gy bundle. See Lemma 
4.2 below.) 

Let Ge X Gy act on Ey by (91, 92)2 = 91295" and let y: #Hy,—> R” be an 
embedding equivariant relative to a representation y: Ge X @„—>0(n). Then 
1X4: EX By > He XR" induces an embedding ¢: Fae > Eag), where 
a: Gg— O(n) is the restriction of y to GexX 1. (The diagram of Section 5.1 
should help clarify the situation here.) ` 


THEOREM 1.3. With notation as above, 
tr (é) D tr (f2)/Gy D v9/Gq =y (62). 


For example, let é be a principal 0 (n +- 1)-bundle and n == (8", r, P,(R)) 
the standard principal Z,-bundle. Denote by é the S*-bundle associated with 
£, by & the P,(#)-bundle associated with & by 2, the principal Z, X 0(n + 1)- 
bundle m: Hg X S"—> Hg, and by ĉa the principal Z,-bundle ma: Be —> Be, 
If y: 8°» R™ is the usual embedding and y: Z, X0(n +1) —>0(r-+1) 
the multiplication map (identifying Z, with the center of 0(n-+1)), it is 
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easily seen that % is equivariant relative to the representation y so, by 
Theorem 1.8, we have rr (é) Ð v¢/Z2—— (fi). : 

Now, if y1: Za X O(n + 1)—> Z, =0(1) and yz: aX On +1) $00 1) 
are the projection maps, one sees easily that y(i) = yıldı) @ y(i), yi) = t 
and y(t) — ra ê (We use ĉa to denote the line bundle associated ` with A 
and Ê the (n+ 1)-plane bundle associated with ¢.) Furthermore, since the 
embedding y: S”—> Rh! has a ZX 0O(n--1) equivariant normal a, it 
follows that v9/Z, is trivial and we have 


tr (é) ® 0! = bs & mete. 


As a consequence, we have the formula of [2], p. 517 (see [13], Lemma 
5.1). 
ler) 2, (1+ o (Ê) ) tre" w(Ê). 


In exactly the same way, we can treat bundles with fiber P, (0) and 
group U(n-+1) and bundles with lens spaces as fiber and suitably restricted 


groups. 


2. The tangent bundle of quaternionic projective space. Let «: 
Sp(i) > SO (4n +4) be the composite. 


Sp(1) > Sp(1) X: > +X Sp(1) C Sp(n+1) C 80 (4n + 4) 


where the first map is the diagonal map. Then Sp(1) acts on St" C Rim 
via a and defines a principal Sp(1)-bundle é with Hz = S**** and Be ~= P,(H), 
the n-dimensional quaternionic projective space. Then, by Theorem 1.1, we 
have . 

(Pr(H)) ® tr(€)/Sp(1) © v/Sp(1) =a ($) 


where » is the normal bundle to the embedding S*** C Rt, In fact, «(é) 
is the (n+-1)-fold Whitney sum (n-+-1)é where Ê is the 4-plane bundle 
associated with é and v/Sp(1) is trivial. Further, if 8: Sp(1) —> 80(3) is 
the 2-fold covering (see Steenrod [11], p. 115), we prove in Section 6 that 
tr(é)/Sp(1) = 8(é). Thus we have* (compare Lemma 4.5 of [1]). 


THEOREM 2.1. r(Pa(H)) OB(E) OO = (n+1)Ê 


For any vector bundle £, we denote the Stiefel- Whitney class by w(t) 
== 2 wi(¢) and the Pontrjagin class by p(£) — Sipi(¢). If M isa manifold, 
v(M)—w(r(M)) and p(M)—p(r(M)). 


‘In [7] the author and W. C. Hsiang prove an analogue of Theorem 2.1 for real,. 
complex, and quaternionic Grassmann manifolds. 
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“To: compute the characteristic classes of P„(H), we need the following. 


Lemma 2.2. Letv be a generator of H*(P,(H); Z) and we HP); Z3) 
tig reduction mod 2. Then 


BO), . 260) —1+4, 
Ea w(é) =i+u.  p(é)—(1-+0)* 
-- We will prove this lemma in Section 7. As an immediate consequence, 
we have .(see Hirzebruch [5] and Borel-and Hirzebruch [2], pp. 517-520) - 


CoRoLLARY 2.3. Letve H*(P,(H); Z) be a generator and u € H*(P,(H); Z) 
its reduction mod 2. Then 


(P,(H)) = (1 +u)", 
p(Pa(H)) = (1 +0) (1 4 40) | 
‘:3, Manifolds of constant positive curvature. Let M be a compact 
‘orientable Riemannian n-manifold of constant positive curvature. ‘As is well 
known (see Hopf [6]), M is finitely covered by the n-sphere S* where ‘the 
group of covering transformations G acts on S8* via a representation a: 
G+>0(n+1). Let == (8*,2,M) denote the covering and y the normal 


bundle of the embedding $* C Rr*!, Since v clearly has a G-equivariant cross 
section, v/G@ is trivial and we have 


 Tamorest 3.1. (MM) @ 6 — a (£). 


We now consider some special cases. 
Let Zm be the cyclic group of order m with generator g. For any integer 
q relatively prime to m, we define a representation a(q): Zm—> 80 (2) by 


cosy N 
siny cosy 





a(a)(o) =] 


where y=2rg/m. If qi,° + +, Qs are relatively ane to m, we let Zm act on 
Set C A+? via the direct sum «(1) Balg) @: - Dalga). This action 
defines a principal Zm bundle é with Hg==—_S*"*t and Bg is the lens space 


L(m; qs’ . "> Qn)- 


‘COROLLARY 3.2. Let L=L(m;q,°' ' ',qn) and ébe the principal Zm- 
bundle over L. Then f 


r(L) =é, ® &ı Ore ($>] é, 
where é is the 2-plane bundle assoctated with é and & is the 2-plane bundle 


690 R. H. SZCZARBA. 


associated with the a(q;)-extension of & Furthermore, if v is a Be 
of H°(L;Z) and u its reduction mod 2, then 


p(L) = (1-+ 0%) I (1+ ge’), 
w(L) = G+) T+ gw). 


The first part of the corollary is an immediate consequence of Theorem 
3.1 whereas the expressions for the characteristic classes follow easily from 
the fact that the a(q)-extension of £ has classifying map 


LC Bz, > Bso(a)- 


Here L is considered the (2n +1) -skeleton of By, and A is induced by the 
homomorphism a(q): Zm — S0 (2). 

Let H,, denote the generalized quaternion group with generators a and b 
and relations aba =b and œ == b? where r= 21, For any odd e q, 
let B(q): Hm—> SO (4) be the representation defined by 


cosy siny 0 


siny cosy 


AOO Eai . ze 


copy ——-SINny 
sin y cos y 


seww |; H 


where I is the 2 X 2 identity matrix and y == qr/2™=*, 


Tf qu * © `, Qn iB a sequence of odd Er we let Hm act on S*+® C Rtat4 
via the direct sum ß(1) BLlqı) ®°--@B(qn). The action defines a 
principal Hm -bundle £ with PSR and Be= N (m; qu’ sqa). 


dirat 3.3. Let N=N (m;gq,'  ',9«) and € be the principal 
Hm-bundle over N. Then 


T(N) OF - BB Oé 
where EBD and &—=B(4) (9) 
Furthermore, if u is the non-zero element of H* (N; Z) ZZ, 


. (8.1) w(N) = (1 +u)", 
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The first part of Corollary 3.3 follows immediately from Theorem 8. 1. 
We will prove ‘equation (3. = in Section 7. | i 


Remark. Note that, ‘since’ the homomorphism B(qy: H(m) > 8O a) 
factors through Sp(1) C SO(4), the group of the bundle r(N) @ 6 admits 
a reduction to the syinpletic group. Thus we can say that N has a generalized 
almost quaternionic, structure. j 

We return now to the general case. Let u be a compact orientable 
manifold of constant positive curvature and let 8 be a p-sylow subgroup of 
the fundamental group G of M. Then $ is cyclic for p> 2 and either cyclic 
or a generalized quaternion group for p==2 (see P. Smith, [10]). Con- 
sidering M-as 8"/G, we see that the inclusion may S C G induces a map of 
S"/S onto 8"/G@ and 8"/8 is either a real projective space, a a lens space, or 
an N(m,q1,'* *;@n) defined above. (Here n==4r+°8 and 2" is the order 
of S.) Furthermore, the map of 8*/S onto M induces a monomorphism on 
mod p cohomology. (see, for example, Cartan-Eilenberg, [4], p. 259.) Thus, 
since we know the characteristic classes of S"/S, we can compute the Stiefel- 
Whitney classes of M as. well as the modp-components of the Pontrjagin 
classes for any prime p. 


4. Two preliminary lemmas. 


Lemma 4.1. Let & be œ principal bundle with Eg compact and suppose 
a group H acts (on the left) on Eg such that 


(4.1) -(ha)g==h(xg) for he H, ze Eg, and ge Gs, 
(4.2) the ‘induced action of H on Bg is without fixed points, 
(4.3) the spaces Eg/H and B;/H are Hausdorff. 


Then the triple (E¢/H, ng, Bg/H) is a principal Ggbundle where nd ts 
induced by we. l 


Proof. All we need to show is that, for any z, y € E/H with r3 = rgy, 
there is a unique g € Gg with zg =y and that the resulting map of 


A’ = { (z, y) € E/E X E/H 3 mgt rgy) 
into Gg is continuous. 


The fact that there is a unique g € Qg with ag = y for (z, y) € A’ follows 
from the corresponding property for é To see that the -resulting map 
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f: A’ Gg is continuous, we let. A = { (x, 4) € Eg X Egs mer —=agy} and let 
f:4— Gg be the map with zf (x,y) =y. Now H acts on A by h(z,y) 
== (ha,hy) and f(ha,hy) =f (s, y) (by (4.1)) so f induces a map fı: 
AJH — Q; Furthermore, the identity map of Eg X Eg onto itself induces 
a map y: 4/H —.4’ which is clearly continuous, onto, and, by (4. 2), ; one-one. 

. In fact, since Hg is compact and’A closed in Ey X Eg A/H is compact , 80. y 
is a homomorphism. Letting f: A’—> Gg be the composite fry, we see that 
af (2, y) =y for (2,y)€ A’. This completes the proof of Lemma 4.1. _ 

: Now, let ¢ and H be as in the lemma and suppose G¢ acts on F. Then, 
we ean form the F-bundle associated with both and €/H. In “fact, E acts 
on Ey Xo, F (on the first factor) and one sees easily that (EX a,F)/H 
= (E/H )Xe, F. Thus the F-bundle associated with ¢/H is the quotient 
‘by u of the Fbundle associated. with é 


bna 4.2. Let £ and ¢ be principal bundles and suppose Gg acts on 
E: bith g(ah) =g(zh), g€@g.c€ By and h€G, Then: Gg acts on B, 
-and ‘the triple (He Xa; Eg, x, Eg Xa, Be) is a principal a where T 
ats induced by the map X: BEX ar x 


Proof. Let 
' A = { (2,2) € Bg X a, By X Be Xa, By> na = re’), 


Ara { (2,4) € Eg X Bed mg — my}, 
i Aem {(2,y) EE XE 3 ma = ry} | 


and let fi: A1 —> Qe fa: Ar— Ge be the maps with af,(x,y) =y for (a, y) € Ay, 

== 1,2. Then we define f: A> G; by the formula f(z, 7) — —filfi(eo’)y,y’) 
‘where (z,2’) in A’ is represented by (2,y,2’,y’) in EXE XEXE, The 
verification that f is well defined and has the en is left to 
‚the reader. 


5. The ara of the main theorems. 


Proof of Theorem 1.1. Since (Bẹ) == 71 (é)/G¢ and e @ rr (É) 
-= r (Hg), it suffices to show that (+(Hg) © ve) /Ge—= a (£). Now, r (Eg). @ ve 
is trivial and can be considered as the bundle over Hg induced by ¢ from the 
trivial n-plane bundle over R”, Thus, we have an equivalence F: E — Eg X Rs 
where E is the total space of r(Eg) ® vs. In fact, this equivalence is Gg- 
:equivariant so induces an equivalence between E/G; and Eg Xa,R". How- 
‘eveT, E/G; is the total space of (r(Ee) D.ve)/Ge and Eg x Ge Bn oe 80 
“Theorem 1.1 is proved. ` 
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Proof U 2. We first prove the,following lemma. 


mines 5.1. Lety be a differentiable n-plane bundle. Then tr(y) 
gt = 


. Proof. ` Suppose nis ‚associated with the 0(n)-bundle a and `=). 
‘Then the total- space of ate, is simply Er Xom Er. (See [2], p. 478). 
The lemma now follows easily from the fact that E, = Rr X RB, 

To prove Theorem 1.2, we first note that the bundle rr (¢) ® ve over E; 
is induced by 6: E,— Fag from the bundle tr(ß (£)). Now, by Lemma 5.1, 
r(ß(E)) is induced by. Tg) : Hae Be Hom &(é) and, since er 
the theorem is proved. 


Proof of Theorem 1.3. The following deren should help the zale 
‚keep track of the bundles involved in this proof, 


SEA 
EX Ey — EX R” 
Pı Pa 
Ba $ E 
Bg X a, By ———> Fe X a; B* 


Tg |. Wal) , 





Be X aB ———> . Bg 
` Note, first of all that the map ws: Er XG, E> Eg Xa, By Siis a 
bundle epimorphism 72: tr()—>7r(é) with kernel. rr(£,).. Choosing a 
Riemannian metric on Fẹ Xa, En, we see that re(é) is equivalent to 
tr(¢s) D r: frp(ta) 80 that tR(f1)/G== [rr (£&) ® T3 Fre (£2) ]/ Ga. In fact, if 
we choose the Riemannian metric on PeX o; En to be invariant under the 
action of Gy, we have i 


: [rr (£2) © ma?re (Es) 1/Gq —17(&)/@ © Mz žre (£) ]/@n- 
Now aa*zp (és) /Gy is easily seen to be equivalent to rr(&) so, to prove the 
theorem, we need only show that [tr (é) © vg]/Gy = y(E). 


> Let. p: E£>En be the. projection map. It is easily seen that Te (£1) 
== p*r (En)}/Qg and. that ve pary/ Ge (see [2], p. 478) so that 
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[re (é) B ve]/ Gn = [p*r (By) /Ge® pary/Ge]/ Ga 
= p*[r(En) D 14]/GE X Gy. , 
Now +(Ey) @w is trivial so the total space of [rr(é&) Gvel/Gy is 
Eg X Ey X B*/Ge X Gy and, since y: Ey— R* is equivariant, the action of 
Gz X Gy on Eg X En X BR is exactly the action which defines y(¢,).. This 
completes the proof of the theorem. 


6. The proof of Theorem 2.1. We will need the following lemma. 


Lessa 6.1. Suppose é and y are principal bundles with Ey == Bg and 
suppose Gy acts (on the right) on & with (g'£)g==g (xg) for gE Gn, TE Eg, 
and g' E Gs. Let A = { (2,4) € Bg Xx He wiih rev = rgy}, f: A> Ge the map 
‘with z =f (x, y)y, and suppose s: Be> Eg is a cross section with the property 
that f(s(xg)g,s(z)) is independent of x for all g€ Gha. Then the map 
B: Gn— Ge defined by B(g) =f(s(zg*)g,s(z)) is a homomorphism and 
E/Gy is equivalent to the B-extension of n. ; 

Proof. First of all, 


B(9:)B(g2) =f (8s (291°) 91; 8 (£) ) f (s (291) ge, 8(2)) 
= f (8(2gs*g1*) 91, 8(292°*) )f(8 (292) ga, 8(£)) 
since f(s(zg*)g,s(z)) is independent of s. But then (8g,)8(ga))s(2) 
= 8(£92"gi*) 9192 80 
B(9:)B(g2) = Fls(297"9:*) 9192) 8 (2) ) 
= (9:92) 
and ß is a homomorphism. 
Now define y: EE> Hy X Ge by w(x) = (ae(2),f(sme(2),2)). Then, 
for g € Gy, 
(zg) = (mg (2g), f (srg (2g), 2g) 
= (we(2) 9, f(s (re(2)g),2g)) 
= (29, F(s(ag)g°, T) ) 
= (29; f(s(29) 97; s (2) )F(s(z), 2) ) 
= (29, B(g)“*f(s(z),2)) 


where z—=rg(2). Thus y defines a bundle map yo: Ey/Gy—> En XG, Ge 
(where Gy acts on Gg via 8). which is easily seen to. be an equivalence. 
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Theorem 2.1 is an immediate consequence of the following. 


COROLLARY 6.2. Let n be a principal bundle, € the principal 0(m)- 
bundle associated with rr(n), and Ad: Gy—>0(m) the adjoint representation. 
Then £/Gy is equivalent to the Ad-ectenston of y. 


Proof. Let T(Gy)» denote the tangent space to Gy at sE Gy, By: 
T(Gy)o—> T (Gq) cg the map induced by right translation, and Lp: T'(Gy). 
—> T'(G@y) 2 the map induced by left translation. Then 

Ad(g) = Rglg+: T( Gy) o> T (Gn) 


Let a: Ey X Gy—> Hy be the principal map and dps: T(@n)o—>T(En)o 
the map induced by po: Gn —> En, pa(g) = p(z, g). Clearly du, takes T( Gy). 
isomorphically onto the fiber of rr(£) containing x. We define a cross section 
sin € by 

s(x) = [dps(d1);° > +, dua(Ym)] 
where v,,° * *,Um is a base for T(Gn). and [dpe(0:), > *, dpalUm)] denotes 
the frame determined by dus(v1),° °°, dpe(tm). 

Now, 


8(zg*)g = [Bgdpag2(01),° + +, Rydpeg2(Um) | 
— [Rylysdps (0s), ` +, Robgrdps(m) | 


since u(u(z,g"), 9’) = p(z, g?g). Therefore, the map 8: G,—>0(m) defined 
in Lemma 6.1 can be identified with the adjoint representation and the 
corollary is proved. 


7. The proofs of Lemma 2.2 and Corollary 3.3. Let 
w = >) w E H? (Bow) ; Za) 


be the universal Stiefel-Whitney class and p = X p; € H*(Bgom;Z) the uni- 
versal Pontrjagin class. We will need the following three lemmas. 


Lemma 7.1. Det 7: Sp(1) C 8SO(4) be the standard inclusion and 
à (j): Baspa; > Bsou) the induced map. Then 


(7.1) A(j)*p—= (1+ v)’, > 
(7.2) l i AG) *0 == 1 +u, 
where v is a generator of H*(Bspu);Z) and u its reduction mod 2. 


Proof. Let 8: C Sp(1) be unit quaternions of the form «+ bi. Then 
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S* is a maximal torus. If 81x S* is the usual maximal torus in! SO (4) 
and d: 8'—> 8? X S the diagonal map, then the diagram 
1 
St — EXA 


%0) 22% sota) 
j 


is commutative. Passing to classifying spaces, we obtain a corresponding 
- diagram in cohomology. Equation (7.1) is ar ‘ximediate consequence of 
- this diagram (see [2]; p- 487) and equation (7.2) follows from the fact 
- that p: reduced mod 2 is wa. 


Lemma 7.2. Let A(8): Bagi) > Bsois) be induced by the two fold 
covering B: Sp(1)-> SO(3). Then 


A(B)*p=1-+ 4u 
where u is a generator of H*( Bayi) ;Z). 
Proof. The short exact sequence 
Toz 8p(1) —> 80(8) > 1 


defines a fiber map àA (£): Bagi) > Bso) with fiber Bz, If (E,,d,) denotes 
the integral cohohomolgy spectral sequence of this fiber space, it is not 
difficult to show that #,,°* © Eo Z Za Bor ZZ, and Bo? X Ept? =O. 
From this, it is immediate that H* (Baga) FE UIAB) BB ate) 32) = and 
‚the lemma follows. - 


Te DNB Ba Beni. ty nd 
Hy C Sp(1). Then A(i)*: A* (Bey 3 Zs) > H*(Ba,.3Z2) is an isomor- 
phism into. 


Proof. In fact, A(t): Ba. > Bgpix) is a fiber map with fiber Su(1)/Hy. 
Using the fact that H° (Baun; Ze) is non zero (see [4], p. 254), we see that 
the mod 2 cohomology spectral sequence is trivial. This proves the lemma. 

Now, Lemma 2.2 follows immediately from Lemmas 7.1 and 7.2. To 
prove equation (3.1) we notice that the map of Hm into SO(4) factors into 
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the composite H,,——> Sp(1) ———> SO(4). The result now follows from 
Lemmas 7.1 and 7.3. 


YALE UNIVERSITY, 
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ON THE TANGENT BUNDLE OF A GRASSMAN MANIFOLD: 


By W. C. Hstanea and R. H. SZOZARBA.! 


Introduction. The purpose of this paper is to investigate the tangent 
bundles of the real, complex, and quaternionic Grassman manifolds. The 
techniques used are those of [7] and the principal result takes the form of 
an equation relating the tangent bundle of the, Grassman manifold to a 
canonical vector bundle over the Grassman manifold. As a consequence of 
this equation, we are able to show that the quaternionic Grassman manifolds 
admit no generalized almost complex structure. This generalizes the known 
result for quaternionic projective spaces (see Hirzebruch [4] and Massey [6]). 

The paper is divided into four sections. The first section’ contains the 
statements of the principal results, the second and third sections. contain 
the proofs of these results and the final section is an appendix in which we 
derive an expression for the Pontrjagin class of a quaternionic tensor product. 

The authors would like to express their gratitude to W. S. Massey and 
G. B. Seligman for several profitable conversations during the nn 
of this paper. 


1. Statement of results. Let K denote either the field E of real 
numbers, the field O of complex numbers, or the field H of quaternions and 
K” the n-dimensional vector space over K. If £ is a right K-vector bundle 
over X, we denote by ¢* the conjugate bundle (a left K-vector bundle) and 
by ĉr the real vector bundle determined by £. If nis a left K-vector bundle 
over X, we can define the tensor product {@x7. In case K is the real or 
complex field, £%xn is a K-vector bundle while if K -== H, (®xn has a real 
structure only. We agree, in all thre cases, to treat £@x7 only as a real 
vector bundle ignoring any additional structure. _ 

Let Ga-ee = Gun,» (K) denote the Grassman manifold of k-planes in Kr 
and ==, x, the canonical K-vector bundle over Gy xx. (The total space Ex 
consists of pairs (z,v) where æ is an element of Qax,» and v is a vector in 7.) 


Received March 14, 1963. 


* During the preparation of this paper, both authors were partially supported by 
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< THEOREM 1. 12 Let r(Gy xx) denote the real tangent bundle of. Ga- ike l 
Then. 


(Gr) D EBr Ener 
where nfr denotes the n-fold Whitney sum fr ®' -`O ér 


Let ¿== & 54 be the canonical. K-vector bundle over Bess Since 
Ann = Gen we have 


Gar) BER nen 


Combining this equation with the equation above ` and a that £@¢ is 
trivial, we obtain 


COROLLARY 1.2. Tf E= nxn and bat are the canonicat bundles 
over Ger then . 


(Gar) 1775 ® Oxi. 


Remark 1. For k = 1, Theorem 1.1 is due to Atiyah [1], P 304. 


Remark 2. ` The analogue of Theorem 1.1 for the Gressman manifold 
of oriented k-planes in R» is true. - In fact, the proof of Theorem 1.1 given 
in Section 2 carries over with no changes. 

. A. real n-plane bundle y is said to admit a pikes pe complex 
structure if there is-an integer m = n/2 such that the group of y @ 6?" can 
be reduced to the unitary group U(m) (6"-* is the trivial (2m —n)-plane 
bundle). We say a manifold M admits a generalized almost cure AHLEN 
if. its tangent bundle does. 


- Treorem 1.3. - The quaternionic Grassman manifolds admit no gen-. 
eralized. almost complex structure (except for G (H) == 8°). 


2.. Proof of Theorem 1.1. Let V,;, denote the Stiefel manifold of 
orthonormal k-frames in K* and O, the group of orthogonal transformations ` 
in K”. Thus O, is either the usual orthogonal group, the unitary group, or 
the sympletic group. Now, if z is an orthonormal k-frame in Kr, Oy acts 
on the k-dimensional subspace of K” determined by z and, under the action, 
an element g€ Op, takes the frame æ into a frame zg€ Vn. In fact, this 
action defines a principal O,-bundle 


f= (Vans a; Gart). 
Define an embedding $: Vya, > R”? as follows. Let = (2,°. +, 2x) 


* John Milnor has also obtained a proof of this theorem using different techniques. 
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be a k-frame in Vy, where t= (Tip * -, 2a) € E". ` Identifying. R*:witk 
the space Mer of n X k matrices over K, we set $(z) = (ay) in Max. Now, 
Ox acts on Mur by right multiplication and determines a representatims 
as 0r.> Onk 


‚LEMMA 2.1. “The embedding 8: Vne > R": described above 418 aqui 
variant relative to the representation a: Ox—> Onr- 


Proof. Let £=. (2,,° + *, T4) be an element of Vas and g an element 
of Os. Lf we represent g as a matrix (gy) relative to the basis 71, ' + +, Ery 
then 2g=(ys* 4x) where yg— Sig Thus $(2g) = (Ya). where 
Ya $, Tyga Which is clearly the matrix product ¢(2)g. $ 

Let rr(£) be the real vector bundle of vectors in r(Vax) tangent to 
fibers of { and vg the normal bundle to the embedding ¢. The group O; acts 
on each of these bundles and by Theorem 1.1 of [7], we have 


(On) D tr(C)/Oz © n/a) 


where «(£) is the K-vector bundle associated with the a-extension of & (sea 
[3], p. 477). It is not difficult to see that a: O,—> On, is equivalent to 
the diagonal representation from which it follows that «({)r-=nér. To 
complete the proof of Theorem 1.1, we need only identify the bundle 
tr(l)/Ox © v¢/Ox with E@xé*. We now do this giving details only in the 
real ease. Thus we agree that for the remainder of this section, the field 
will be the real numbers unless explicitly stated to the contrary. ` 

Let d, be the space of kX k symmetric matrices and define Ay€ dx, 
1 SiS jS k, by Ay—1/V2(By+ Ey) fori < jand Ay = Ey where Ay is 
the matrix with (p,g)-th entry == 8,)5j,. Define maps sy: Vna > RE Max 
by sy(2) = (2) Ay. 


LEMMA 2.2. For each z in Vax, the vectors sy(z), LSS] S k, form 
a basis for the normal space to d(Vnx) at p(x). Thus, the maps sy deter- 
mine k(k +1)/2 independent cross sections in the bundle vg. 


Proof. Define hypersurfaces Ly, 1SiSjSk, in Rık by 
Ly == { (pq) € Mat > Düren 845} 
It is a matter of elementary calculus to show that (2,,)Ay is normal to Ly 
at (tq). Furthermore, $(Vax) = N Ly so the sy(z) describe normals to 


(Fs). Since the Ay form a base for Jy, it follows that the sy(£) form 
a basis for the normal space to ¢(Vax) at o(z). 
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Define a representation 8: Ox> Or), by requiring that aB(g) = gag* 
for gE On, a € 8y RRM, 


Lemma 2.3. The bundle vg/Ox is equivalent to B(f). 


Proof. Let [s,4(2)] denote the frame determined by the s,(z) (in some 
fixed ordering). The map s(x) = [sy(x)] determines a cross section in the 
principal bundle y associated with vg. Let X = {(2,y) € By X Hy 3 aot = any} 
and f: X Orun) the map with z==yf(z,y) for (z,y)EX. Then, for 
g € On, 

s(zg)g* — TrgAug*] 
= [r4,ß(g)] 
= [s4(2)]8 (9) 


so f(s(zg)g,s(z)) ==B(g). Lemma 2.3 now follows from Lemma 6.1 
of [7]. 

We now turn our attention to the bundle rr(£)/Or. 

Let J, denote the space of k X k skew symmetric matrices with basis 
By Ey— Ey, 1SiSj=%k and define maps ty: Vne—> R" by ty(x) 
= 6(2)By. Identifying the fibers in rr(£) with subspaces of Rr* via the 
embedding ¢, we have 


Lemma 2.4. The mappings ty: Va, determine k(k—1)/2 
independent cross sections in the bundle rr(£). 


Proof. Suppose, first of all, that 7 is an arbitrary principal @ bundle 
and that »: Ey xX @— E is the principal map. Then, for each ze En, 
we have a map ps: G> En, pe(g) = u(z,g), and therefore a map dps from 
the tangent space @, of G at the identity to the tangent space of Hy at z. 
In fact, dus takes G, isomorphically into the space of tangents along fibers 
atc. Thus, if V4, < +, V, is a basis for Ge, the maps 2— du,(V,) determine 
r-independent cross sections in the bundle rr(n). 

In our case, the group of the bundle is O, and its tangent space at the 
identity can be identified with Jy. If the basis By, 1Si<jSk, is used 
with the method above, it is readily seen that the resulting cross sections are 
exactly ty. . 

Identifying R*@»/2 with the space Jr, we define a representation 
y: Ok—> Ok-1)72 by requiring that ay(g) =gag* for a€ Jr, gE Or. Just 
as in Lemma 2.3, this representation is exactly what is needed to prove 
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Lemma 2.5. The bundle rr(£)/O, ts equivalent to y(£). 
_ Combining Lemmas 2.3 and 2.5, we know that © 


tr(£)/Oz ® vg/Ox = (B ® y) (£) 


where 8 @ y denotes the direct sum of the representations 8 and y. Now, 
RF = Men r D Jr and the representation 6 ® y can be identified with 
à: 0% Ox: where a(g) = gag, gE Ox, a€ Myx. It is easily checked that 
A is equivalent to the tensor representation. This completes the proof of 
Theorem 1.1. 


8. Proof of Theorem 1.3. We agree that, throughout this section, 
the underlying field will be the field of quaternions unless explicitly stated 
to the contrary. 


Lemma 3.1. The manifold Gy, admits a generalized almost complex 
structure if and only if the bundle £®@xy &* admits a generalized almost com- 
plex structure. 


Proof. For any finite complex X, we let KO(X) denote the ring of 
stable real vector bundles over X and KU(X) the ring of stable complex 
vector bundles over X (see Atiyah-Hirzebruch [2]). Let p: KU(X)—> KO(X) 
denote the additive homomorphism defined by the map &>£r. It is easily 
seen that a bundle £ has a generalized almost complex structure if and only 
if ¢ (as an element of KO(X) is in the image of p. 

Now, let X= Gex We know from Theorem 1.1 that (Gr) 
= (n+k)ég—fOn& as an element of KO (Gar). Since the group of ér 
can be reduced to Sp(k), (n-+k)£r certainly has a generalized almost com- 
plex structure. However, p is additive so (n-+k)ép—é@y€* is in the 
image of p if and only if @y é* is in the image of p. This proves Lemma 3.1. 

The proof of Theorem 1.3 proceeds by induction. For n—1, Ga» is a 
quaternionic projective space which is known to admit no generalized almost 
complex structure for k >1 (see Hirzebruch [4] and Massey [6]). Suppose 
that, for all k, G,.,, admits no generalized almost complex structure. Then, 
by Lemma 3.1, f14@é*%11,, admits no generalized almost complex 
structure. Now, if j: Gis. Gas is the inclusion map, 1 = f Enx (the 
bundle induced by j from & x) 80 Enie Qa E*'n-ı, = J* (Enr Ou En). Thus, 
Eine Bu &*,,, can admit no generalized almost complex structure and the 
theorem is proved. 


4. Appendix: The Pontrjagin class of a quaternionic tensor product. 
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In this section, we derive an expression for the Pontrjagin. class. of the 
quaternionic tensor product of two bundles. We first recall the splitting 
principal (see Hirzebruch [5], p. 97). 

Let £ be a quaternionic n-plane bundle. Associated with £, there is a 
space X=X(£) and a map f: X— B; such that 


(4.1) the induced bundle f*£ splits into a Whitney sum of quaternionic 
line bundles, 
(4.2) the map f*: H*(B,: Z) > H*(X;Z) is a monomorphism. 
We will identity H*(B;: Z) with its image under f*. Thus, there are 
elements t,- - +, 0n€ H*(X;Z) such that p(£) =M (1-+2,), where p(£) is 
41 


the total Pontrjagin class of £. 
Suppose now that é and ¢ are two quaternionic vector bundles over a 
space B with 


pé) =I (+2) 
1 


PO =Ñ +y). 


PROPOSITION. The total Pontrjagin class of the tensor product Eu ¢* 
ts given by 


p(&@u t") -HI Anty (y) 


This proposition is an immediate consequence of the splitting principal 
and the following lemma. 


Lemma 4.1. Let £ and £ be quaternionic line bundles over a space B. 
Then 
Pı (ÉBua $7) = p1 (£) + p: (4), 
Ppa (EBn E*) = [ps (é) — p: (£) ]?. 


Proof. Define a representation «: Sp(1) X Sp(1)— SO(4) by requiring 
that a-a(2,y) = zay* for z,y € Sp(1) and ac H Rt. Then a induces a 
map à(a): Bspa) X Bspa)—> Bao and, if f,g: B>Sp(1) are the classi- 
fying maps for é £ respectively, £@yf* has classifying map. 


Aa) (F X g) : B> Bao 
Let y ys: S'— 8! X S T? be the homomorphism defined by 


yı (z) = (2,2), ya (z) = (z, — T). 
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Then, we have a commutative diagram 


Ay) 


„Br 


| a(o) 

Baro) X Bsgo) —— Bow , 
where i and j are induced by the usual inclusions, A(y) is induced by 
yyıX ya, and A(a@) is induced by a. Now, if t1, 4, aro the canonical 
generators of H?(Br,;Z), Yı, Ya the canonical generators of... 


H* (Bsp X Bapaay 34), 
and’p,, pa the universal Pontrjagin classes in H*(Bsou);Z) it is readily 
seen that 
l A(y) "ut fe, Ay) Fug = t — tis 

* ps == Uy? + Us" put, 

yet, SF Yo = thy" 
Lemma 4.1 now follows easily since +* and j* are monomorphism and 
fy. = p.(8), g*ya = p(t). 
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GEODESIC PARALLEL COORDINATES IN THE LARGE. 


By Purp Hartman." 


In the first part of [4], Fiala deals with the following: Consider a 
complete, analytic, Riemann element of arclength defined on a plane M; @ 
a closed, analytic, Jordan curve on M; and y(r) the set of points z inside 
of @ [or outside of @] at a distance r from 6, dist(6,2)=r. (Here 
dist(@,z)°is defined in terms of arcs of least length joining @ and z.) 
Fiala shows that there exists a (possibly empty) set E of exceptional r-values 
which does not have a finite cluster point with the properties that (i) if 
r¢ EZ, then y(r) is the union of a finite number of Jordan curves; (ii) the 
length L(r) of y(r), ré B, has a continuous derivative for which certain 
inequalities hold; (iii) furthermore, the function L(r) can be defined at the 
points of r€ E so as to become a continuous function. The fact (iii) greatly 
enhances the usefulness of Fiala’s differential inequalities. 


Recently, Ahlfors [1] applied Fiala’s results and raised the question of 
their validity without assumptions of analyticity. It will be shown below 
that, under rather mild differentiability conditions, the analogues of (i), (ii) 
remain valid in the following sense: the exceptional set Æ is a closed set 
of Lebesgue measure zero (and Fiala’s differential inequalities for L(r) 
remain valid for r ¢ E). Difficulties arise, however, with (iii) ; in fact, L(r) 
can be discontinuous. 

This can be seen from the example illustrated in Figure 1: Let M be a 
plane with the Euclidean metric, @ the Jordan curve ABCD: - - in which 
ABC is. a semi-circle of radius d, CD is a line segment, DE and EF are 
quarters of circles of radius d, FG is a line segment, etc. The heavy lines 
represent the “cut-locus,” i.e., the endpoints of geodesics (line segments) 
orthogonal to @ beyond which these geodesics do not minimize the distance 
from @, the light lines indicate some of the minimizing geodesics joining @ 
and the “cut-locus.” (The “cut-locus” consists of a line segment and two 
parabolic arcs.) The closed curve just inside @ is a locus y(r), O<r<d. 
The innermost closed curve is a locus y(r), d<r<3d. The locus y(d) 
consists of the dashed, closed curve and the line segments ab. It is clear 


Received February 10, 1964. 
1 This research was supported by the Air Force Office of Scientific Research. 


705 


706 PHILIP HARTMAN. 


that the length L(r) of y(r) has a jump discontinuity at r—d. (In this 
example, @ is only of class C+ but similar examples exist with @ of class C”.) 

It turns out that this example involves the only obstacle to the con- 
tinuity of L(1r): the existence of “many” geodesic arcs orthogonal to @ at 
both endpoints and having midpoints which are on the cut-locus but which 
are not “focal” points (i.e., intersections of infinitely near geodesics or- 
thogonal to @; Theorem 6.2 below). 

In general, L(r) can be extended (i.e., defined on the exceptional set E) 
so as to be a function which is locally of bounded variation. This function 
has no purely singular component. If one considers only points inside @ 





[or outside @], its purely discontinuous component is monotone in such a 
way that formal integrations of the differential inequalities are valid. 

In particular, the considerations in the second part of Fiala’s work remain 
correct under the assumptions of this paper. Also, the arguments in Ahlfors’ 
paper [1] are valid under the present assumptions on the Riemann metric; 
cf. the end of 86 below. : 

‚ This paper is concerned principally with a discussion of geodesic parallel 
coordinates based on a Jordan curve 6. As pointed out by Fiala ([4], p. 
332), corresponding results about geodesic polar coordinates follow by choosing 
& to be a small geodesic parallel circle. 

: For convenience, references to known facts about the “focal points” and 
“extreme points” defined below will be made to Fiala [4], although many of 
them were given earlier by Poincaré [11], Myers [10], and Whitehead [12]. 
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1. The Riemann manifold M. Let E(z,y), F(z,y), @(z,y) be defined 

for all (z,y) and consider the element of arclength 
(1.1), ds? —= Bda? + 2Fdedy + Gdy’. 
The “local” assumptions on (1.1) are (i) ds? is positive definite; (ii) #, F, 
G are of class C°; (iii) ds? has a curvature K(z,y) of class O". The “in 
the large” assumption is that (iv) ds* is complete (in the sense of Hopf and 
Rinow [9]; cf. below). Local condition (iii) holds if F, F, G are of class 0? 
or if (1.1) is the element of arclength on a surface of class C? embedded in 
Euclidean space. (Remarks about reducing the local assumptions (ii), (iii). 
are made gt the end of § 2.) 

Below M will refer to the Riemann manifold of points (z,y) and the 
element of arc-length (1.1). For brevity, write z in place of (z,y). If 
Q: 2(t) = (x(t), y(t)) foraStsb is a rectifiable arc and z(t) is absolutely 
continuous, then “length of Q ” will mean the Riemann length, 


(1.2) L(@) = Ser 4 OF a’y! + Gy} dt, 


where the argument of E, F, Gis z(t). By the distance between two points 
Zo = (Zo Yo); %1 = (%1, 41) is meant d(z,2,) inf L(A), where the “inf” 
refers to all rectifiable arcs @ joining z and zı. Then M becomes a metric 
space with the metric d(z,z,). The completeness of (1.1) means that M 
is a complete metric space; [9]. 

If @ is a rectifiable are joining Za zı such that L(Q) —d(a, 2), then 
Q will be called a minimizing arc (which will be abbreviated to min-arc). 


PROPOSITION 1.1. If Zo, zı are distinct points, then there ewist min-arcs 
Q joining them and any min-arc G is a geodesic; [9]. 


2. Geodesic parallel coordinates. The considerations below deal with 
geodesic parallel coordinates based on a Jordan curve 


(2.1) Q: 2,(9) — (%0(7),40(9)) 


of class C°. Let Lo —2(@), q is (Riemann) arclength on @, and -a(q) is 
defined for 0S q S Lo When convenient below, 2,(g) and other functions 
of q will be considered periodic of period Lp. 

For a fixed g, let &(q): (p,q) = (x(p,¢),9(p,q)) be the unique 
geodesic starting (for p—0) at the point z,(q) € @, orthogonal to @, 2(p,q) 
is outside of @ for small p > 0, finally, p is (Riemann) arclength on $ (q). 
Then, by local condition (iii) on ds*, z(p,q) is of class C?; [6]. The com- 
pleteness of (1.1) implies that z(p, gq) is defined for all p, —œ < p <% ; [9]. 
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In parallel geodesic “coordinates” (p,q), (1.1) becomes 


(22) 0 dst = dp? -+ f’ (p, q) dq’, 
where, in terms of zp == ĝz/ĝp, Za = ĝz/ôq, > 

Exp + 2F typ + Gy = 1 
(2.8) Ept + F (EpYa + Yeta) + Gy pq = 0. 


Hag + 2Fagyq + Gy? — f (p,q). 


The argument of F, F, G in these relations is z(p,g). The function f?(p, q) 
in (2.3) has a square root of class O+ satisfying 


| 70,9)-1, $ 
(2.4) fp(0, q) = x(q) = geodesic curvature of @ at way: 
f (p,q) = (HG — F*)48(2, y) /8(p, 9). 
Also, f(p,q) has a continuous second partial derivative with respect to p 
satisfying the Jacobi equation 


(2.5) foo(p,9) +E (#(p,9) )f(p, 9) = 
Note that, at a point (p,q), 
(2.6) Ip Val, q) = 0 & A(z, y)/0(p.4 j= 
It f(po, go) =0, then, since fs£0, (2.5) implies that fp(Po qo) 40. 


Hence, f(p,q) 0 has a solution p—p(q) of class C1 for q near qo, 
P (qo) = Po, and 


(2.7) dp(q)/dq =— fe (p (4): 4)/fr (2 (9) 9)- 


- A p-value where f (p,q) = 0, or the corresponding point z(p,q) € M, will be 
called a focal point on the geodesic & (q). 

: If f(p,q) = 0 for a positive p-value, let p= p(q) denote the least such 
p-value; otherwise, let P(g) ==». Correspondingly, let p =N (q) be the 
largest negative zero of f(p,q) or let N(q) = —» if there are no such zeros. 
The point p—P(g) [or p= N(q)] will be called the first positive [or 
negative] focal point on 8 (q). 


_ Remarks on local conditions. If conditions (ii), (iii) are replaced by 
(i) E, F, @ are of class C* and (iii’) ds? has a continuous curvature K (z, y) 
(in the sense that the formula of Gauss-Bonnet is valid), then & (q) is unique, 
s(p,g) and 2)(p,q) are of class C7, f(p,q) is continuous and has continuous 
partial derivatives fp, fpp satisfying (2.4), (2.5); cf. [6] or [6]. Corres- 
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pondingly, local solutions p = p(q) of f (p,q) —0 are continuous (when they 
exist.) Under these conditions, the results of 86, in particular, the main 
Theorems 6.1 and 6.2, remain valid; however, it is not clear, in this case, 
that the set of exceptional r-values is of Lebesgue measure zero, i.e., that 
(6.3)-(6.4) hold almost everywhere. (It can be mentioned that the results 
of § 5 are valid with the following possible exceptions: the parts of Proposition 
5.4 involving p(qo) =P (qo) <0 and v(qo) = N (qo) > — ; Corollary 5.1; 
the assertion “of Lebesgue measure zero” in Corollary 5.3 and Lemma 5.2; 
“@?” should be replaced by “C*” in (i) (ii) of Proposition 5.6; Lemma 
5.4.) 


- 


8. Preliminaries. For reference, it will be convenient to state here some 
notations and tools from the theory of functions of a real variable to be used 
below in avoiding assumptions of analyticity. 

If 8 is a Lebesgue measurable set, | S| denotes its Lebesgue measure. 

Let h(q) be a continuous function of bounded variation on an interval 
Q&S q and T,(g) a non-decreasing function such that T(r) —T,(c) 
is the total variation of h(q) on [o,r] C [1,93]. If S is a Borel subset of 
[9 92], “variation of h over S”? means the Lebesgue-Stieltjes measure 


J, | dh | = J, aT,(q) of 8 or, equivalently, the Lebesgue measure | 7,(9)| 
of the image of 8 under the map g-> T;(q). 

Lemma 3.1. (Banach [2], p. 228). Let h(q) be a-continuous function 
on Egg and n(r) =m (r) the number, OSn(r) Soo, of solutions q 


of the equation h(q) =r. Then h(q) is of bounded variation tf and only if 
n(r) ts Lebesgue integrable over —œ < r < œ ; in which case, 


(D fn(r)dr— {varh on [gu ge]} =| Talgo 40])| 


‘ and OS n(r) <œ almost everywhere (4.6. except for a set of r-values of 
Lebesgue measure zero). 


In 885-6 below, the following consequence of this fact will be needed: 


COROLLARY 3.1. Let h(q) be a continuous function of bounded variation 
on [91,93] and V(r) the variation of h over the set {q: h(g) <r}. Then 
Vir) ts absolutely continuous and , 


(3.2) V(r) -f n(u)du, 
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, x T 2 
(3.3) F= en Í n (u) du. 
$ g 


The following well known fact will also be used. 


| Proposition 3.1. ‘Let h(q) be continuous and of bounded. inter ‚on 
[gu 92]. Then the variation of h over the set {q: dh/dq exists and is 0} 
is zero. 2 og u 


4, Locus of first focal points. A standard theorem (J acobi) in the 
calculus of variations is the following: . 


Proposto 4.1. When P(q) [or N(q)] is finite- saad: the locus of 
first positive [or negative] focal points: a=«2(P(q),q) [or z—=2(N(q),q)] 
is an envelope of the family of geodesics z ==z(p,q). It is of class C* on 
any q-interval on which P(g) [or N(g)] is finite-valued and dP/dq 540 [or 
aN /dg 0] ; furthermore, the Riemann arclength element along such an are 
is de= | 4P (q)| (or ds = | aN (q)|). 

In fact, dz(P (q), q)/dq == z (P, q) dP/dq. 


Lemma 4.1. For any r>0, the functions P,(g)—=min(P(g),r), 
N,(q) =max(N (g),—r) are uniformly Lipschitz continuous. l 


1 

‘Proof. Consider only P(q). If P(qo) <œ, then P(g) is of class Ct 
for q near qo and (2.7) holds with p(q)—P(q). Note that f,(p,q) is 
bounded on the set {(p, q): |p| Sr, 0 Sq S Lo} and that 1/f,(p,q) is also 
bounded on the set {(p,q): f(p,q) —0, |p| Sr}. Hence there exists a 
constant Co—Co(r) such that ` eS w 
(| P(q)—P(q2)| Sco] n—n| if 0< P(g) Sr on [gu g]. 
Since the constants cy depends only on r and not on the interval [q1, q2], 
the auton follows. l 


| Cononzant 4.1. For almost all r, the number of g-values, os <g<L, 
where P(q) =r [or N(g) =r] is finite. 

‘This is a consequence of Lemma 4.1 and Lemma 3.1. For ifn,(r) is 
the number of g-values where P,(g) =min(P(g),s) takes the value r, then 
n,(7) <œ for almost all r. But ifr < s, then n,(r) is the number of g-values 
where P(q) =r. 


‘Coronary 4.2. Let Zi be the set of numbers r such that P(q) =r or 
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N(q) =r has at least one solution q= q, such that dP/dg or dN/dq exists 
and ts zero at q= qo Then Z, ts of Lebesgue measure zero. 


Cf. Proposition 3.1. 


5. Extreme points. For any point z= (z,y), let.|d(z)|=infL((Q), 
where the “inf” refers to all rectifiable Jordan arcs joining a point of & 
and z, and let d(z) <0, =0, or > 0 according as z is inside, on, or outside 
&. If Q has the property that it joins a point zo(q) € 6 and z and | d(z)| 
— L(Q), then @ will be called a 6-min-are. 


Proposition 5.1. For any point zé @, there exists at least one @-min- 
Te 
arc @. I£ @==2z,(q)z is a G-min-arc, then (@ is a min-arc and a sub-are of 
= oe, 
&(q). IË z, is a point of G, then the sub-are 2,(g)zı of @ is a 6-min-arc 
nn 


and the sub-arc 2,2 is a min-are. 
Propositions 1.1 and 5.1 imply the following: 


Proposition 5.2. If Qa, A, are distinct [@-min-arcs] min-arcs, then Cj, 
G, have at most their endpoints [not on 8] in common. 


Let p(q) =supp taken over positive p-values such that the sub-are of 
&(q) corresponding to [0,p] is a @-min-arc; correspondingly, let v(g) 
= inf p taken over all p < 0 such that the sub-arc of & (g) belonging to [p, 0] 
isa @-min-are. Thus —œo < (q) <0 < plq) Som. A finite p-value p == p(q), 
v(q) or corresponding point z(p(q),q), z(v(g),g) of M will be called an 
extreme point of $ (q). Following Whitehead [12], the set of extreme points 
2(p(q),4@), z(v(g),g) can be called the “cut-locus” of M relative to @.) 


Proposition 5.8. An extreme point z€ Af is either a first focal point 
on a @-min-are or the intersection of at least two @-min-ares; cf., e. g, [4], 
p. 314. 


Proposition 4.1 (i.e., the “Envelope Theorem”) implies 


Proposition 5.4. p(g)=p(g) for all q, while p(qo) = P(g) <œ implies 
that dP(qo)/dq exists and is 0; similarly, v(q) =N(q) for all q, while 
¥(Go) =N (qo) > —oo implies that dN (q.)/dq exists and is 0. 

For the sake of brevity, only the set of extreme points outside of @ 
and p(q) will be considered in the remainder of this section. It will be 
clear that analogous results hold for extreme points inside @ and v(q). 
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` COROLLARY 5.1. If p(qo)=P(qo) <0, then the lower left and upper 
right derivatives of p(q) satisfy Drp(qo) = 0 = DFe (q0), 
For if q, is near go, then p(q1) —p(9) SEP (q1) P(g) by Proposi- 
tion 4.1. 


Proposition 5.5. The function p(q) is continuous (even at points 
where it is not finite-valued). 

Cf. Whitehead [12], pp. 701-702. (Fiais similar proof [4], pp. 316- 
317, makes unnecessary use of his analyticity assumptions.) 

Let a point z, outside of @ be called normal if it is the endpoint of 
exactly two 6-min-ares and is not a first focal point on either of them. In 
this case, 29==2(p(q),q) holds for exactly two values of q, say qg== 1, 42 
subject to OS qı < q2 < Lo. Furthermore, p(q;) <P(q,;) for es 2 A 
goa 2(p(q),q) which is not normal will be called anormal. 


ia 5.1. Let 2,2,°  : be a sequence of distinct anni points 
and let „>20, an a. Then z, is a first focal point on a @-min-arc. 


Proof. If infinitely many of the points z,,2,,' > > are first focal points 
of 6 -min-arcs, then it is clear that Z, is also. 

-Thus, it can be supposed that no 2, is a first focal point of a 4-min-are. 
Hence, 2, is the endpoint of at least three @-min-arcs. Thus, for fixed n, 
there exist three g-values gin < Gan < qan (< qı + Lo) such that z(p(gm), Gin) 
— 2, for i= 1,2,3. It will be supposed that the enumeration of gin, Gar, Jon 
is chosen so that 0< qin < Lo and that the @-min-arcs on B (qin), & (Gen) 
together with the arc on @ corresponding to qın S 9 qen forms. a Jordan 
curve with an interior J, containing the @-min-arc on $ (gs): The sets I, 
and Im are either disjoint or one contains the other. 

1 It can be supposed that g*==lim qa exists, as n—w, for jat 2,3. 
If two of these limits are equal (mod Leo), say gg? [or gg? or 
g? Ti -+ Lo], then it is clear that the we limit point is a first 
focal point on the 6-min-are on 4 (qg!) == &(q?) [or & (q*) =a (¢ ) or 
8 (g) = 8 (¢)]. 

: Thus, in order to complete the proof it is iaa to show that 
P E< < EH La is impossible. 

: If infinitely many of the sets [,,J,,-- + are disjoint, then it is clear 
that: qt =—= g? — gè. Thus it can be supposed that I, DI D- - or that 
I, e IC+». Assume the first case. Let Iyr, Inz denote the portion of 
In contained, respectively, inside the Jordan curve formed by the @-min-arcs 
on'& (gi), &(qx) and an are of @ or by the @-min-arcs on &(q2), & (qs) 
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and an arc of @. Hither In C Inc or Iwn C Inn holds for infinitely many 
values of n. For the sake of definiteness, let Imı C Ine hold for infinitely 
many n; ie, Qin < qims < Jan < Gsm < Gan L Gon holds for Senan 
many n. Then g?==q°. This completes the proof, since the case I, C I, C 

is similar. 


COROLLARY 5.2. An anormal point 2, is either a first focal point on 
a @-min-are or an isolated anormal point. In particular, the set of anormal 
points z, is closed. 

A number r > 0 will be called anormal if there exists a Safe of q= qo 
such that p(qo) =f and z(r, qo) is anormal. 


COROLLARY 5.3. The set of anormal r-values is closed and of Lebesgue 
measure zero. 


Proof. In fact, it is clear from the last corollary and from Proposition 
5.4 that an anormal r-value is either contained in the set Z, of Corollary 4.2 
or is an isolated anormal value. Hence the set of anormal values is of 
Lebesgue measure zero. Lemma 5.1 implies that this set is closed. 


Proposition 5.6. Let z, be a normal point (so that »—=z(p(g),g) has 
exactly two solutions q == qı, qa (mod Lo), ı < qa < qı + Ly and plg) < Plg) 
for j= 1,2). Then (i) p(q) is of class C? on a neighborhood of q == qi, q2; 
(ii) there exists a strictly monotone function v(q) of class C? on a neighbor- 
hood of gg, with the properties that v(q:) — qı, p(v(g))=p(g) and 
z(p(v(g),v(g)) =z(p(g),g) for q near qz; finally, (iii) the locus of extreme 
points z==2(p(q),q) for q near gs (or qı) bisects the angle between the g- 
min-arcs on 4 (g), &(v(q)) meeting at z(p(g),g). 

Cf. [4], pp. 317-319. The proof follows from the fact that z = z(p, q) 
has two inverses of class C? near z: p= p(z), q= q;(z) such that p;(zo) 
= p (qı) =p (q2) and q;(2o) = q; for j==1,2. The normality of z and the 
fact that the set of anormal points is closed imply that the locus of extreme 
points is determined by the equation p,(z) = p:(z). Since $ (q1), 8 (gz) 
cannot meet at a zero angle, the implicit function theorem is applicable (i. e., 
either ô (p, —Ps)/öz or 8(pı— p:)/ðy does not vanish at 2). 


Proposition 5.7. Let 2, qu qa be as in Proposition 5.6. Then 
dp/dq =0 at q= q, (and/or g= q2) if and only if $ (q1), 4 (qa) are con- 
tinuations of each other (i.e. the two @-min-arcs meeting at z meet at an 
angle r). 


Since (p,q) is an orthogonal coordinate system on M, this proposition 
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follows from (iii) in Proposition 5.6 and the fact that the arc p—p(q) is 
orthogonal to the line q = q, if and only if their images on u are orthogonal 
at 20. 

| (In MEN analytic cases, the possibility that the @-min-arcs on 
5 (4); S (q2) are continuations of each other can occur only for isolated 
G-min-ares; [4], pp. 820-322.) 


‘ Proposition 5.8. Let gẹ be an isolated anormal point which is not a 
first focal point on any @-min-arc through it. Then (i) there exists only a 
finite number n (=: 3) of q-values (mod Lo), say, q = qu’ ` ‘> Yn) Such that 
2—2(p(g), q); (ii) p(q) is of class C* on all small closed intervals ending 
at qd; (but de(q-+ 0)/dgs4dp(q—0)/dg at q= q; is not excluded) ; finally 
(ili) the set of extreme points in a neighborhood of z, consists of n.arcs of 
class C* ending at z,; at each point z of this set, these arcs bisect the angle 
between a pair of @-min-arcs intersecting at z. 


‚Proof. Assertion (i) is clear since z, is not a first total: point on any 
-min-arc ending at 2. For any q; and small q-interval I, abutting at q; 
there is a q, t—~t(j,I,), and an interval I, abutting at q such that 
there exists a continuous, one-to-one map v: I—II, and p(v(q))=4 
2(p(v(q)),%(q)) =#(0(q),g) for g on I» Also, the locus 2—=2(p(q), 9) 
for 'q:7q€ I, bisects the angle between &(g), &(v(g)). The assertions 
(ii), (iti) follow from a continuity argument. (The finiteness of the one 
sided derivatives of p(q) at qy follows from the fact that the angle between 
S (4), &(v(g)) cannot be zero.). 

‘A number r>0 will be called exceptional if it is either anormal or if 
it is normal but there exists a q-value qo such that p(qo) =f, teh O /area ts 


Lemma 5.2. The set of exceptional r-values is closed and of Lebeague 
measure zero. 


Proof. The set is closed since the set of anormal points is closed and 
dp/dq is continuous at normal points. 

, In view of Corollaries 4.2 and 5.2, it is nitide to show that the set 
of normal exceptional r-values is of Lebesgue measure 0. The set of g-values 
on 0<q<L, for which 2(p(q),qg) is normal is open, by Corollary 5.2. 
Let: [a, 8] be a closed g-interval such that q€ [a,8] implies that 2(p(q),¢) 
is normal. Then dp/dg is continuous on [4,8]. Hence the set of r-values 
such that p(g)—r has a solution g€ [a,8] at which dp(q)/dqg=0 ia of 
Lebesgue measure zero; cf. Proposition 3.1. Thus Lemma 5.2 follows. 
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Lemma 5.3. Letr>0 be non-exceptional. Then the equation p(q) =r 
has at most a finite number np(r) of solutions q (mod La). The integer 
np(r) is even and constant on any interval of non-exceptional r-values. 


Proof. If np(r) =w, then there exists a q-value q, such that p(qo.) =” 
and q is a limit point of q-values satisfying p(q) =r. But this contradicts 
the fact that z(p(qo);qo) is normal, dp/dq is continuous at gg, and 
dp (qo) /dq 0. 

It will remain undecided whether or not the function px(g)==min(p(g), E) 
is of bounded variation. But when it is, the following holds. 


LEMMA 5.4. Lei R>0 be fixed, and let pr(g) =min(p(g),R) be of 
bounded variation on OS q S Lo. Then pr(q) is absolutely continuous. 


Proof. It can be supposed that R is non-exceptional, for otherwise con- 
sider p,(q) and let s> R—0. 


Let «> 0 be fixed. Then, by Corollary 3.1, there exists an y= 7(e, R) 
such that 


(5.1) Í, npo(rjdr <e if |3] <q 


and % is a Borel subset of [0, R]. The integral in (5.1) is the variation of 
pr(q) over the set 


(5.2) , S, = {q: p(q) € Z}. 


The set of exceptional points r contained in [0, R] is compact and of 
Lebesgue measure. zero. Hence there exists a finite number of open non- 
overlapping intervals d,,d,,° - -,8, containing these points such that the end- 
points of &,° ' -,8, are non-exceptional and 


(5.3) X= {5,U.:-U&}NL[0,R] satisfies || <7. 


Tf Xis defined by (5.8), the intervals which constitute 3 have non-exceptional 
endpoints. The coresponding set’, in (5.2) is the union of non-overlapping 
sub-intervals At,---,A° of [0,Z,] which are open relative to [0, Lo]. 
Furthermore, 


(5.4) {var pr over j= Ù At} <e. 
é 4-1 
The set 
Sa—{q: 0SqS Lo p(q) S R, p(q) ¢ 3} 
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is closed. Near each point of Sz, p(q) is of class O". Hence there exists a 
constant c > 0 such that 


(5.5) ges > | dp(q)/dq| Se. | | 


Let A- <, Aj be an arbitrary set of non-overlapping closed intervals on 
0=g=SL such that l 


(8.6) Sal <e/e 
4=1 
It will be shown that if 4 — [a,8] and Apr = pr(ß) —pr(a), then 
, J 
(5.7) | È | Apr | < 2e. . 
i : 1 
To this end, note that the set 
J e 
U &— U At 
4=1 1 


consists of a finite number of closed Liga: say Att. ++, A™, It is clear 
that if qE A‘ for some i=e+-1,- -+,m, then either qE 8, or pr(q) = R. 
Let eo + 1Si<m Ad [4,6] and A‘pr—pr(8)—pa(a). IE pr(ß) = pr(a) 
= R, then Atop—=0. If pr(«) <E and pr(ß) =R, then gme gE Sa. Let 
y >a be the least q-value such that p(q) =R, so that a<ySA. Then 
la y] C 9; and (5.5) imply that 


| Aa] =| p(y) —e(a)| Se(y—a). ' 
This argument shows that, in all four cases, pg(a) SR and pr(ß) SR, one 
haa | A‘pr|Sc|At| for e+1&i& m. Consequently, 


| 


| Zlami<f, miito jat <eto$ | ul 


1 


Thus (5.7) follows from (5.6). This completes the proof of the absolute 
continuity of pr(q). a 


6. The r-loci. Let f= infy(q), so that —o<f<0. Below only r- 
values on the range fr <œ will be considered. 
Gauss’s geodesic parallels T (r) are the loci I(r): a—2(r,qg), 0S q £ Lo 
T(r) is a (not necessarily simple) closed curve and 2¢(r, go) 0 if r AP (qo). 
Hence, for almost all r, T(r) is locally an are of class C?. 
Define y(r), the r-locus, to be the set of points z€ M such that d(z) =r. 
Then y(r) C T(r). If r> F and p(q) =r has no polipa then y(r) =T(r) 
is a simple closed curve. 
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Proposition 6.1. I£r> 0 is non-exceptional, then p(g) = +r. bds- an even 
number of solutions 2m (mod E) which if m >0, can. be enumerated as 
Qı < Br La L` <S Bm (< ae: such that p(q) >r on (ax, Bx) and 
e(g) <ron (Br arn), for k—=1,-- ‚m with om == a, + Lo: The locus y(r) 
consists of the set of points BER q), @: Sq =f; for k= 1,' +. "m, and 
is a set of simple closed curves of class O? except for hie corners at 

z(t, œx), 2(r, Bx); cf. [4], pp. 325-326. (The z-image z==z(r,q) of one of 
the q-intervals ‚[@x, 8x] is, in general, only an arc on one of these closed 
curves.) The total (Riemann) length of these curves is 


m Be 
(6.1) L(r)=¥ JF, Dig; 
k-i a 
L(r) is of class C? and 
m Br 
(6.2) aL /drm È { f ton g)dg +F (r, Be) 4B/dr—F (r, ax) dan/ar}. + 
k=l an 
Similar results hold for non-exceptional r < 0. 


The formulae (6.1), (6.2) are given by Fiala [4], pp. 826-328. His 
considerations (depending on Proposition 5.5 and the fact that fp(r, ¢)/f(r, q) 
is the geodesic curvature of the geodesic parallel z==z(r,q)) lead to the 
following differential inequalities: 


THEOREM 6.1. Let r340 be non-exceptional. Then 
I no: 
(6.3) ab (r)/ars S «(q)dg—C(r) if 0S <0, 
0 


"In 
(6.4) dL(r)/dr= f x(q)dg+O(r) if <r <o, 
where x(q) ts the geodesic curvature of ‘Bat 2(9); 


(6.5) of Kaa, 


A(r) 


K is the curvature of (1.1), dA is the Riemann element of area, and the 
integral in (6.5) ts over the domain A(r) bounded by @ and the r-locus en. 
Consider the (p, q)-set 


(6.6) D= {(p,9) : v(4) < p <p(q), 089 < Ly}. 


The map (p,q) —>2(p,q) from D to M is one-to-one and from the closure 
of D to M is onto (not one-to-one). Let x(p,q) be the characteristic function 
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of D,.so that x(p,q) is 1 or 0 according as v(g) <p < p(q) does or does 
not hold. Then the function (6.5) is given by 


DES Ela) dx Wird it => 0, 


The function L(r) has been defined in (6.1) only for non-exceptional 
r>f#F. In order to make the differential inequalities (6.3), (6.4) more 
useful, it will be shown that the integrated forms of the differential inequalities 
(6.3), (6.4) are valid, even though it may not be possible to extend /,(r) 
to a continuous function; cf. (6.11)-(6.12). 

For Fr <w, put 


Lo 
(6.8) Li) — | xe Ding), 
0 
which reduces to (6.1) for non-exceptional r. l 
For f&r <w, define the q-sets Q (r) on OS gL, by 
Q (r) — tg: (gq) =r is normal, dp(q)/dq=0}, r > 0, 
Q(r) — {q: v(q) =r is normal, dy(q)/dq == 0}, r <0. 


For r>0, q€ Q(r) if and only if p(q) =r, z(r,q) is normal, and the two 
-min-arcs meeting at z(r, q), are arcs on the same geodesic. The sets Q (r) 
are pairwise disjoint for positive [or negative] r-values and so, | Q(r)| = 0 
except for an at most countable set of r-values. 

For f&r <w, define the function 


I(r) fies Í, JODU tor rz. 


(6.9) 


(6.10) 
J (1 PN fh „dd for r=0, 


BR 


Since f 0 on the set of integration, J(r) is non-decreasing for r>0 and 
non-decreasing for r= 0. The function J(r) is purely discontinuous and its 
discontinuity points are the r-values where | Q(r)| 340 (for q€ Q(r) implies 
that f(r, g) > 0 since z(r,g) is not a first focal point on & (g)). 


THROREM 6.2. The function H(r)—=L(r) +J(r) is absolutely con- 
tinuous for FEr<o. 


Remark. In particular, L(r) is of bounded variation on bounded inter- 
vals of [7,00) and has no purely singular component (in the sense of 
Lebesgue). Furthermore, I(r) is absolutely continuous if and only if 
I(r) ==0, ie, if [Q(r)) =0 for r>r. 
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COROLLARY 6.1. The integrated forms of (6.3), (6.4) are valid for 


L(b) —L(a) < f (dL/dr)dr for OSa<b <o, 
(6.11) a 


w= f (dL/dr)dr for Za <b S0; 


more generally, if $(L) is a continuously differentiable, non-decreasing func- 
tion for OSL <w, then 


HE) — olL) Sf PEOL) for 0Sa <b <a, 
(6.12) 
E0) )— ela) Bf" POE (r)ae for PS a<dS0, 
where ¢' (L) = de/dL and L’ (r) =dL/dr. 
Proof of Theorem 6.2. Consider the case 0Sa<b<o. Let e>0 


be fixed and let . 
Q= {q: p(g) Sb, f (plq) 9) Se/2}.- 


Then Q* is a closed subset of 0 = q & Lo and can be covered by a set S“ con- 
sisting of a finite number of closed subintervals of [0, Lo] on which p(q) <œ 
and f(o(q),q) S8e/4. Tf plq) Sb and q¢ 8%, then f(p(q),9) >«/2>0, 
so that o(g) <P(q) So. In particular, z(p(q),q) is either a normal or an 
isolated anormal point. Thus, on the closure Re of [0, Lo] — S°, the function 
ps(g) =min(p(g),b) has bounded right and left derivatives. The set Re 
consists of a finite number of closed intervals and py(q) is of bounded 
variation on R°. Thus, by Corollary 3.1, f0So<r=b, the total variation 
of p(q) over the set {g: ge Rs, o < p(q) S7} is given by 


(6. 18) T({q€ Rha <p(q) Er) f nfr), 
Co 
where n(r) is the number of points q in Rt where p(q) =r. 
For later reference, note that 


(6. 14) p(q) Sb and f(p(q),¢) Ze > ge Re 


In order to prove the theorem, it will be shown that if e> 0, then there 
exists an y == n (€; a, b) > 0 such that if 8,,- -.-,8 is a set of non-overlapping 
intervals on arb, then 


k . È A 
(6.15) 2 |e | <R2eL, whenever 2| & | <4, 
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where 3H == H (r) —H (0), || —=r— o if &= (o,r]. 

Let c==c(b) denote a constant such that 
(6.16) |f(p,9)| Se for 0S p Sb, 054S Lo ee 
(6.17) ie) —-Mrsg)|seler—m| for 0S p Sp S. 

Note that, by (6.8), ~ 


&L — Ste, q) 8ixdq + f ln, q) difdq, 


where, for example, ix = x(r, q) —x(o, q). Since dx 0 unless o <p(q) < T, 
in which case sx ==—1. Hence (6.17) shows that 


BJ F(o(q),9)dq-+ 206Ls | 8, 
iO) ; 


where @ denotes a number (not always the same) satisfying |0| S1 and 
(6.18) S(t) ig: o <p(q) St} — {q: p(q) € &}. 
In view of (6.10), one has 


= I È fand 


e<tsre Q(t) 
Since ge Q(t) implies that p(q) —t, 


a= f LEOD D 
where . ; 
(6.19) R(i) = New. 


Clearly, R(t) C S(t). Consequently, Heid gives ° 


6.20 $A | = ‚g)d 2clL ; 

(6.20) ES), TP DI + Bele | à| 
In order to appraise the last integral, write 9(i) —R(i) as the union of three 
sets 5,(t), S2(t), Ss (+) defined as follows: Let O(t) be an open set con- 
taining H(i) and the discrete set of q-values in S(t), if any, for which 
#(p(g),g) is an isolated anormal point and such that | O(i) —R(t)| <] & |. 
Put 


(6.21) = [S (i) —R(i)] N 0 (i), so | 8. | < |è]. 
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(6.22) S_== [8 (i) —~E()] N {q: Fe) <e}, 
(6.23) S: = [S (i) —R (1) ] — [S1 U 84]. 


In particular, if q€ 8,, then z(p(g),g) is normal and dp/dg>£0. The sets 
8,, S are not necessarily disjoint. Since f(p(g),g)=0,. 


ee) | Joa = Si T J: tfi 


By (6.16) and (6.21), 


6.25) ff Sel Sel als 
and, by (6.22), 
(6.26) J S191580]. 


The closure of Bs contains only points q such that 2(p(q) ‚g) is normal and 
dp/dq 0; cf. (6.21)-(6.23). Thus, dp/dg 0 is continuous on the closure 
of S, and so, there exists a number c,(e) —¢,(«,a,b) >0 such that 


(6.27) © > g€ 8> | dp/dq| 2a (e) >0. 
Note that, by (6.14) and (6. 22)-(6.23), Ss C Bt. Thus, it is einer to 
speak of the total variation T'(S,) of pa(q) over Ss. By (6. 2); 


c1 (€) | Sa | S T(S) ; so that, by (6.18), a (9| 3] = J, n(r)dr. 
Consequently, the last integral in (6.24) satisfies 
(6.28) Si S e| S| S (e/a(e)) 1 n(r)dr. 
In view of (6.20), (6.24), (6.25), (6.26), and (6.28), 
S| | So(2Ly +1) Es +en+ (c/a) A ff n(r)dr. 
4=1 4=1 iiv 3 ae 3 
Since the function n(r), defined in connection with (6.9), is Lebesgue 


summable for 0&rÆ b, it follows that there exists an y—7(e) > 0 for 
which (6.15) holds. This proves Theorem 6.2. 


Proof of Corollary 6.1. For r= 0, let 
i(r) =—[4(2(r))—$(L(r—0))]; 


722 PHILIP HARTMAN. 


so that j(r) 20 and j(r) =0 unless r = 0 is a discontinuity point of L(r) 
(ie, of J(r)). Put 
Je(r)— 3 jlt) for r=. 
aisr 


This is a finite sum or a convergent series for if 0 S ¢' (L) Sc on a suitable 
L-interval, then i 


Z i(t) Se JM) —I(t—0)] =c (r). 
ogir ositgr 


The function 

H¢(r) —$(L(r)) +Je(r) 
is continuous. In fact, the uniform Lipschitz continuity of #(L) on bounded 
ZL-intervals implies that Z/g(r) is absolutely continuous, since L(r) has no 
purely singular component. Furthermore, for almost all r, dHg(r)/dr 
= ¢/(L(r))L/(r). Hence 


E . 
H (b) — H; (a) = f p (L(r))L’(r)dr for OS a<b<o. 
s š 
Since Jẹ(r) is non-decreasing, this gives the first part of (6.12). As the 


proof of the second part is similar, the proof of Corollary 6.1 is complete. 


According as F&r <0 or r>0, let D(r) denote the intersection of 
the (p,q)-set D in (6.6) and the strip r<p<0 or the strip OS pir. 
Let A(r) denote the subset of M which is the image of D(r) under the map 
(p,q) > 2(p,q). Then, if r is non-exceptional, A(r) is the subset of M in 
(6.5) which is bounded by @ and y(r). By (2.2), 


(6.29) Ai) SS: SSR axle, odd if +r >0. 
In particular, the area A(@) enclosed by @ is A(f). 
From (6.8) and (6.29), 
(6.30) dA(r)/dr=—+ L(r) for almost all r= i, 
This leads to 


COROLLARY 6.2. If A(G) is the (Riemann) area of the interior of g, 
then 


(631) AB) f° L(p)dp. 


This result is given by Fiala [4], p. 332, under his assumptions. In 
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particular, the results of the second part of Fiala’s paper are valid under 
the conditions of this paper since they depend only on the inequalities (6.3)- 
(6.4), (6.11) and on (6.7), (6.30). 


Remark. The part of Ahlfors paper [1], p. 5, depending on Fiala’s 
results, uses (6.3) and the following inequality : 


roras f’ L(r)L'(r)dr for 0SaSb. 


As this is a consequence of Corollary 6.1 with ¢(L) =’, Ahlfors’ argu- 
ments remain correct under the conditions of this paper. 


7. Isoperimetric inequalities. In addition to the assumptions in g1 
on M, assume that 


(7.1) o= f f\x@plda<e, 
where dA = (EG— F*)idady. Put 

7.2 = K(a,y) aA. 
(7.2) n= f f (oy) 


Let @ be a rectifiable Jordan curve in N; L(@) its (Riemann) length 
and A($) the (Riemann) area of the interior I of 6. Then 


(7.3) L*(B)/A(B) Z4r— (8), 
where, 
(7.4) Sf, max(0, K(,y))aA. 


The isoperimetric inequality (7.3) in the analytic case is given by 
Fiala [4] who assumes K(2z,y) 20 instead of (7.1). (In this case, the 
convergence of the integral in (7.1) follows from the assumption of com- 
pleteness; Cohn-Vossen [3].) Fiala’s proof of (7.8) is also valid under 
the more general condition (7.1). A different proof of (7.3) is given by 
Huber (ef. [8]) under relaxed eonditions of differentiability. 


In general, the following form of (7.3) is false 
(7.6) 1*(6)/A (8) = 4n—2u( 8), 


where 


(7.6) | Ks, K(z,y)dA. 
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5 “Tt will be shown, however; that (7:5) .is “nearly” correct if @ is replaced 
by ‘the outermost component: of y(r) for ‚large non-exceptional r >.0. - 


| THROREM 7.1. Let M satisfy the local smoothness and completeness 
assumptions of $1. Assume also that (7.1) holds. Let @ be. a Jordan 
curve of class 0%. Let r>0:be non-exceptional, L*(r) tha length of the 
outermost component (—=Jordan curve) A*(r) of the r-locus y(r), and 
a the area. of the interior of. d*(r). Then. ; 


L#*(r)/A*(r) > 4h —2p as Dee 
os oe I2(r)/A(r) dr — 2p as T—>0o. 


' ‘This is contained in Fiala [4r “for the analytic case when É ts, y) = 20. 
Note that ‘Theorem 7.1 implies.. 


A 7. 1. Let M be as in o Theoren 7. 1. Then’ nc: 
(7. 8) | Eh E, 

' The statement that (7. 8) follows from the completeness of M and (7.1) 
is due to Cohn-Vossen [3], under weaker assumptions of differentiability 
than in Theorem 7.1. For another proof, under still weaker conditions of 
differentiability, see Huber [7]. °° 

The proof of Theorem 7.1 will involve an , isoperimetric inequality similar 

to. (%15) which “depends on’ the: position of: @ relative to the set of points 
(2,9) € A, where”) K-(2,y) | is not small. Roughly speaking, it is required 
that these points be near the “center of &.” 


| Lemma 7.1. Let M be as above. Let @ be a rectifiable Jordan curve: 
à its interior; — d (z) = dist (z, 6) for z€ &; and F=mind(z) for ge à. 
Let > 0 and let pe be chosen so that fon <0 and 


er E is a | i : S Suu IE)SPE ale (z, 2 = ze 
and put BER 

(¥. 10) - ie gate © en so that TSP 1: 

Then- | 

(7. z OITO 


i Proof. It can be supposed that @ is of class 02, for haris 6 can 
be suitably approximated. The domain of integration in (7.9) is A(pe) 
in the notation of Theorem 6.1. Hence 


(7.123) [O(n < S S FGM | dd Se tor 0 >r>pe 
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By the: theorem of Gauss-Bonnet, the integral in ne: 4). is) E Hence 
(6.4) and (6.11) give 
(718) E(p) SLO) + [2x —n(6)]p— f O(r)ar 

l ? 
for 7S p <0, where L(0) =L, =2L(8). Another integration and (6.31) 
give . 
(119 AB) S- Lau R— f° (Fr) O(r) ar. 
From |C(r)] S% and (7.12), it Ben that 


a 79 z 
| j (#—1)C(r) dr | So f (re + end. 
P ? 
This is majorized by 
w (Pe—F)?/2 + RS (1/2) [wart + 2]. 
Hence, by. (7.14), 
A(6) S—L(0)F— oF /2, 
where c is the number on the right of (7.11). 
If c<0, then (7.11) is trivial. If c>0, the last inequality can be 
written as 
A(@) SL? (0) /2c— (1/20) [L (0) — cr]?. 
This gives (7.11). 


Proof of Theorem 7.1. It will first be shown that the Lemma 7.1 
implies that 
(7.15) lim inf L*?(r)/A*(r) Z Ar — 2p. 
T> o 


To this end, note that there exists an r.>0 so large that if &*(r) is the 
interior of Q* (r), then 


(7.16) REICH) dA ceif ren. 


Let r>r, and apply Lemma 7.1 with @ replaced by @*(r). The 
corresponding number # is a number r* satisfying —r*<r—7. Choose 
the analogue of pe to be pf ==— (T— re). Since z€ A*(r.) implies the 
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analogue of d(z) < Pe the inequality (7.16) shows that the analogue of 
(7.9) holds, so that 7.* is an admissible choice. It is also seen that |. - 
0<AS (n—F)/(r— Ff) 30 as rom. l 
Hence (7.15) follows from (7.11). 
Note that, by (6.3) 
dL/dr <2 —p(B) —O(r) 

for non-exceptional r > 0. It is clear that 

| KB) +O(r) >p as reo. 
Hence, for large non-exceptional 1 > 0, 
(2.17) dL(r)/dr <r—ate, 


so that 
2L(r)dL(r)/dr S2(2r—p+e)L(r). 


Thus, Corollary 6.1 (cf. the Remark at the end of 86) shows that if r, is 
sufficiently large, 
1) — In) S2 (2r —p +e) [A (r) —Aln)] for r> ro. 
Hence . 
(7.18) lim sup L? (r) /4 (r) S 4r — 2p. 
mo 


Since L*(r) SL(r) and A*(r) 2 A(r), Theorem 7.1 follows from (7.15). 
and (7.18). 


Remark. The proof can be modified to show that, under the conditions. 
of Theorem 7.1, 


(7.19) L(r)/r dar —u as ro, 


L*(r)/r > 2a—p as ro, 
and so, by l’Höpital’s rule, 
(7.20) A(r)/(4r?) > 2a— p as TI 00. 


(This is also given by Fiala under his conditions of analyticity and 
K («,y) 20). 

In order to prove (7.19), note that under the assumptions of Lemma. 
7.1, one can deduce the inequality 


L(8)/(—?) = r — p(B) —oca—e 
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from (7.13) with p=f and L(0)—=L(8). An application of this in- 
equality, with @ replaced by @*(r), as in the proof of Theorem 7.1, gives 
lim inf L* (r)/r Z 2r —p. 
roo 
On the other hand, 
lim sup L(r)/r Sr — u 
>» 


follows from (7.17) and Corollary 6.1. Since L*(r) SL(r), this proves 
(7.19). 


THE JOHNS Hopkins UNIVERSITY. 
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ON RIEMANN’S METHOD AND A VARIATION BY MARTIN: 
By A. G. Maoxre. i 


' 1 Riemann and Martin functions. In 1860 Riemann [4] gave an 
account of a method of solving Cauchy’s problem for a linear, second order, 
hyperbolic differential equation in two independent variables and this is now 
generally referred to as Riemann’s method. If the differential operator L 
in ‚its normal hyperbolic form is defined by 





(1) le + ar +06, 

where g, f and c are functions of = and y, then the solution of the equation 
L[¢] =F (z,y) 

which, together with its normal derivative, takes prescribed values on some 

non-characteristic curve Æ can be given explicitly in terms of the Riemann 

function R(2,4}%o,¥o) associated with the operator. This is a function of 


the active variables a, y and the parameters 2, yo. As a function of z, y it 
satisfies the adjoint equation so 


a. R HER. 
Further, R obeys the relations 

(3) ER on Y= Yo, 

(4) | 0 On T= To 

and the PE condition 

6) B (To Yo; to Yo) —1. 


If the data are given on the curve £, the essence of Riemann’s method is to 
integrate the identity 


RL[6] — $L*[R] 
_19(p oo 2R (a 
iz (z y $ ay + 298e) +4, (2% ge ae +R) 
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over the area PAB, where P is an arbitrary point with co-ordinates. (£o, Yo) 
end PA, PB are the z and y characteristics through P, A and B lying on &, 
and then use Green’s theorem. Because of a (2), (8), (4) and 1), 
this gires ` if Æ has negative slope, 


p lin) = HGR) a +3(6R)n 


8 a 
+ f El er afley ) da —(z iy ar by y+ 20R4 )ay 
+ ff Reses) P mariy. 
PAB 

Minor sign changes are necessary if the curve £ has positive slope. The same 
Riemann function can also be used to solve the characteristic boundary value 
problem wherein & (but not its normal derivative) is given on two inter- 
secting characteristics, 

In 1943 Martin [3] described an alternative but similar method which 
is applicable to equations of the form 


y 3 (AaB) 
Ge rer) re. 


Although the differential operator in this equation is not as general as that 
in (1) it is nevertheless a very important special case as it includes many 
of the equations which are of most interest, including that which arises in 
one-dimensional gas dynamics and which prompted Riemann’s original inves- 
tigation. Martin’s method also depends on the determination of an auxiliary 
function of T, Y, To ANd Yo which he calls the resolvent but we find more 
convenient to call the Martin function. This function M (£, ¥ 3 Loy Yo) must 


satisfy 
eM 6M aM 
(8) ne F Tj- 
(which is not, it should be noted, in general the adjoint equation) and the 
extra conditions 
TE aM 


(9) ~ = =1 on y= Yo 
2 aM 
(10) . i By =Í on T= To, 


(11) : H (To, Yo 3 To, Yo) =0. . 
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These may be expressed in the form 
(12) | M(E, Yo; To, Yo) =T — To, M (Zo, Y ; Bos Yo) == Y — Yo- 


In its applications the Martin function may be indeterminate tò the extent 
of an arbitrary constant so that (9) and (10) suffice to define it. However, 
it is convenient to determine it uniquely by (11) for the sake of completeness. 
í an, ôM , OM p , Op ; 
If (7) is multiplied by ray (8) by a + by and the resulting 
equations added, then 


ED EN-E ren. 


I£ this equation is integrated over PAB and Green’s theorem is used, 


blog) = TREE fi ae eas E a 


+ Ma F(a,y)didy. 
PAB 


We have slightly generalized Martin’s original result, which was estab- 
lished in [3] only for the homogeneous equation (7) with F(z,y) —=0, and 
for the following reason. The general similarity between the two methods 
suggests a close relationship between the Riemann and Martin functions. 
Yet if we set F(z,y)=0 in (6) and (13) and compare the remaining terms, 
writing f=g=<-a in (6), there is no obvious simple way in which the 
functions R and M appear to be related. On the other hand, if we assume 
that F(z,y) is non-zero but that the given values of & and its normal 
derivative on £ are zero, then all the terms on the right hand sides of (6) 
and (13) disappear except for the final double integral term in each case. 
Since F(a,y) and the curve £ are arbitrary, it follows that the Riemann 
and Martin functions are related by 


öM , 6M 

m r-i ( 8) 

Having established this remarkably simple relationship between the two 
functions, we should now verify that those parts of the solutions (6) and (13) 
which correspond to non-zero data on Æ, that is the right hand sides without 
the double integral terms, are in fact identical when use is made of (14). This 
is not difficult. We first set F — 0, f — g =g in (6) and then substitute 
for R in terms of M by means of (14). The function a(z,y) is now 


(13) 
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eliminated by using (8) since it does not occur explicitly in (13). There 
results a line integral along AB together with some additional terms and 
when use is made of relations such as 


ah =) f a ( =) ô ( A 
—) [8 —) = — | $ — ) de + — =) dy, 
Ca) (7) a da \* Gy ty? ay 
equation (13) is recovered. We omit the details. 


Equation (14) shows how the Riemann function can be easily obtained 
when the Martin function is known. The process can be reversed for from 
(8) and (14) 

PH 


$ . ea 2a (T, y) R. 


Hence, using (9), (10) and (11), 
M (T, Y ; Zo; Yo) 


(15) a y i 

= S S. a(X, Y)B(X, Y ; 2, Y) AX dY +--+ yY — To — Yo. 
Thus any method by which Riemann functions can be obtained is also applic- 
able, because of equation (15), to the problem of finding Martin functions; 
and conversely. Copson [1] has made a survey of the known methods of 
obtaining Riemann functions. As a result of (15), this survey can be 
regarded as covering the Martin functions for any equations included in it 
which are of the form (7). 


2. The Euler-Poisson equation, We illustrate this equivalence prin- 
ciple by considering the example discussed by Martin himself in which 
a(z, y) == N/(x-+y) and there results the Euler-Poisson equation 

ao N a6 , ð$ 

le u) 
where N is a constant, The Riemann function for this equation can be 
expressed in terms of a hypergeometric function or a Legendre function 
(see [1]) and the Martin function is given in [3] in terms of Appell’s 
hypergeometric functions in two variables. It is not easy to deduce one 
function from the other by (14) or (15) from these representations because 
of the complicated way in which they contain s and y. Some years ago the 
author, in an unpublished note, suggested a representation of the Riemann 
function as a contour integral and this was included by Copson [1] in his 
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survey. .We shall not discuss the motivation for this approach here: as: this 
is fully explained.:in [1] but merely quote the result which is > ee 


at ry í tape +9) 
Cy (&—o)N(C-+ yo)” 


For non-integral values of N the integrand has branch points at {==2, To, 
—1,—Yo. (For convenience we may assume that x, to, Y, Yo are all positive.). 
If those connecting z, z, and — y, — Yo are joined by cuts, then the integrand 
is analytic and single-valued in the Z-plane cut in this way. The contour O, 
surrounds the right hand cut and for what follows it is convenient to introduce 
a second contour C; surrounding the left hand cut in the opposite direction. 
Since the integrand in (16) is of order ¢* for large |¢|, we can deform C, 
into the integral from ico to —iw and from there into Oz. 

Equation (16) is clearly in a suitable form to apply (15) as the term 
a(z,y) cancels the factor outside the integral. Thus 





(16) R(T, Y ; Xo, Yo) = 


H(z, Y; Los Yo) 


-4f (e—a — (E— TAN HE DEE) y 
miN wo)" (E + Yo)” 


ee 


By the argument of the preceding paragraph this may also be written with 
C, replacing C,, and if the mean of the two is taken, then 





(—2)N (+ y)¥ 
(17) M(2, Y; 20 Yo) = — Saar ziy. SE EEF = 
since 
(18) | N Nm) 


Rat J o, (E— To)” 


with a similar result for the other integral involving y and y, round 0;. To 
prove (18) we first assume that —1 < N <1, flatten the contour onto the ` 
real axis in order to evaluate it and then make appeal to the theory of analytic 
continuation to establish it for general values of N. 

The contour in (17) can be regarded if desired as a figure. of eight 
around the two branch cuts. When N is integral the Martin function is a 
rational function of £, Y, £o and yo since the branch cuts now disappear and 
the integral in (17) can be evaluated by determining residues at multiple 
poles. The poles are at to, — Yo when N >O and at z, —y when N <0. 
When N =a 0 we revert to (15), set «(X, Y) = 0 and obtain 


(19) M (2, yY ; To, Yo) =E + Y — To — Yo. 
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This is the case of the ordinary wave equation with Riemann function unity 
as verified by (14) and (19). 

Although equation (17) was obtained by applying (15) to the contour 
integral representation of the Riemann function, it is interesting to comment 
briefly on how it should have been derived directly from the defining 
equations (12). It was shown by Martin that M(z,y; Zo, Yo), While satisfying 
(8) as a function of x and y, satisfies the original homogeneous equation 
((?) with F(a, y) = 0) as a function of z, and yo. (This property is shared 
by the Riemann function and the proof is similar.) Now ({—z)¥({+y)¥ 
is a solution of (8) for an arbitrary value of ¢. Thus we are tempted to 
try an expression of the form 





(¢—2)*(E + Y)N 
a (E — 2) CE + Yo)” al 


e—a) 
E PR een (zer OA 


since this will satisfy the correct equations as a function both of z, y and of 
Zo, Yo for arbitrary analytic functions h,(£), he(€). When y = yo the integral 
round C, vanishes and to satisfy M—«—, in the case we must solve 


M (2,4; Xo, Yo) ma 


"(da)" =. 
| Jo, Goan HOR 

for hi(£). The solution of such a contour integral equation with an arbitrary 
right hand side is given in [2], §2 and using this we find that h,(¢) 
—=—1/2xiN. Similarly ha({) ——1/2atN and equation (17) then follows 
as before. 


3. Conclusions, In the preceding sections we have demonstrated the 
close connection between the methods of Riemann and of Martin for solving 
linear, second order, hyperbolic equations and between the two auxiliary 
functions upon which these methods depend. Two aspects would seem to 
be of some interest. The first is that, although in practice most of the 
applications are to homogeneous equations with non-homogeneous boundary 
-conditions, much more insight is gained by considering the non-homogeneous 
equation with homogeneous boundary conditions. This, of course, is linked 
with the basic definition of the ordinary Green’s function G(x, 4320, Yo) 
which satisfies L[@] = 8(c—2,y—yo) together with homogenéous boun- 
dary conditions although it is used to solve L[$] —0 where ¢ satisfies non- 
homogeneous boundary conditions. The second point of interest is the use 
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of contour integrals which in this case enables the algebraic manipulation 
to be carried out with the minimum of effort. 

In his original paper Martin states that the conditions defining the 
resolvent or Martin function are simpler than those for the Riemann func- 
tion and that the form of solution as a line integral is also simpler. While 
this is certainly true it seems that some of the advantages to be gained in 
this way are offset by the fact that in general the Martin function is a more 
complicated expression than the Riemann function as might be expected 
from (15). 


VIOTORIA UNIVERSITY OF WELLINGTON, , 
New ZEALAND. i 
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NON-LOCAL ELLIPTIC BOUNDARY VALUE PROBLEMS. 


By Feuıx E. Browper.* 


Introduction. In recent years, an intensive investigation has been 
carried through by various writers of local or differential boundary value 
problems for linear elliptie differential operators A of order m which are 
elliptic or coercive in the sense that for u satisfying the homogeneous boun- 
dary conditions, there exists c independent of u such that: 

(1) | 2 | Dew [rs cf] u lza + 1 Au |} 

lan 
(CE, e By, [1], [6]-[9], [12], [17] Chap. X, [18]-[21], [23]-[25]). This 
investigation has also been extended recently ([2]) to semi-local boundary 
value problems, i.e. with the boundary conditions determined by differential 
operators with singular integral operators as coefficients. 

It is our object in the present paper to establish some useful general 
results concerning the general class of non-local elliptic boundary value 
problems for an elliptic operator A on a bounded domain G. 

Let W™?(G@) be the Hilbert space {u|D%ue L(G), |a|Sm} with 
inner product (4,0) m— Z (D%u, D*v). Then by a general linear elliptic 

ajm 
boundary value operator, we shall mean a bounded linear mapping y of 
W™?(Q) onto a Hilbert space T such that the set {u | yu = 0} is dense in 
L(G) and such that there exists c> 0 for which 
(2) lu Ivo S ef] u lan + 1 Aula} 
for all u in W™?(@) for which yu =0. 

We can associate with each such boundary value problem {A,T,y} two 
linear operators which we denote by (A,y) and Ay. The first, (A,y), is the 
bounded linear mapping of W™?(G@) into L?(G) T given by 

(A, y) (u) — [Au, yu]. 
The second, A, is the closed densely defined linear operator in L*(G) given by 
D(Ay) = {u | ue W™?(G), yu = 0} 
Received April 15, 1964. 
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and 
Ayı Au, ve D(A,). 


It is an easy consequence of the definition of ellipticity for {4,T, y} that 
each of these operators has a closed range and a finite-dimensional nullspace. 
There are two other types of analytical facts that are of especial interest in 
connection with such operators and whose proof for differential boundary 
value problems is not so direct. These are embodied in the following questions: 


(1) Are (A,y) and A, Fredholm operators, i. e. do their ranges have 
finite codimension in the respective range spaces? 


(2) Suppose {A,T,y} and {A’,I’,y’} are elliptic problems which are 
formally adjoint, i.e. such that 


(Au, v) = (u, A’v) 
tf yu= 0, yYu==0. Then, is it true that 
| Aym (Ay)* 


in the sense of adjoints of unbounded operators in Hilbert space? Is tt true 
that the range of Ay coincides with the annihilator of the nullspace of A’y? 


We construct here a general principle to answer such questions which 
we apply under detailed hypotheses elsewhere. To state this principle, we 
introduce the concept of a continuous family of elliptic boundary value 
problems: If Q is a topological space and for each w in Q, {A (a), T, y(w) } 
is an elliptic boundary value problem of order m on G, the family is said to 
be continuous if the mapping „> (A(w),y(o)) is a continuous mapping of Q 
into L(W™*(@), L?(@) @T) with the uniform topology. Then our basic 
result is the following: 


Let Q be a connected space, {A(w),T,y(w)} and {A’(w),T, Y.(w)} two 
continuous families of elliptic boundary value problems which are formally 
adjoint for each œ in Q. EUER that for a single parameter value wo, we 
know that 

(A’ (wo) ya) = (Ao (0) yiwo)”. 
Then for all w in Q, 
(4a) Ir = (Ala)ym)* 
while . 
l (A(w),y(o)) and (A (w))yio 
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are Fredholm operators for every w, they have the same index, and this index 
is independent of w in Q. 


The practical import of this result is that if we can deform a given 
elliptic problem into a special problem (A (wo), y(wo)) whose adjoint problem 
‘we can handle (in particular, a differential boundary value problem) while 
simultaneously deforming the formal adjoint into the adjoint problem, then 
we have shown that the formal adjoint is the real adjoint and in particular 
that (A,y) is a Fredholm operator. l 

General boundary value problems for elliptic operators were first sys- 
tematically studied for second-order operators by Calkin [13] and Visik [27]. 
If A is an elliptic operator of order m, A’ its formal adjoint, Visik introduced 
the minimal and maximal operators of A: 

Ao the minimal operator of A, is the closure as an operator in L(G) 
of A restricted to 0,” (G), the O” functions with compact support in G; 


A,, the maximal operator of A, is given by 


D(A) = {u.| we L(G); Aue L?(G) where A is 
| ak as a distribution derivative} 
Aw Au. 


Then the closed operator T is said to be the realization of A under a 
homogeneous boundary condition if 


A,CTCA,. 


If we assume our boundary value operator y is proper, i.e. yu==0 for 
uE C,” (Q), then it is easy to see that A, is a realization of A in the above 
sense. Moreover the realization T == Ay for some elliptic boundary value 
problem {4,T,y} if and only if D(T) C W™?(G@). Thus the class of boun- 
dary value problems which we consider here contains the subclass of Visik’s 
problems for which D(T) C W™?(@). 

Abstract boundary value problems have been studied for other purposes 
in Hérmander [16], Browder [9], [10], [11], Peetre [20] and Phillips [22]. 
An investigation of special classes of non-local elliptic boundary value 
problems along the lines of Calkin [13] has been made for second-order 
equations by Bade and Freeman [3] and Freeman [14] and for get ores 
equations by Beals [6]. i 

In Section 1, we establish Theorem 1 which is an abstract analogue of 
our result on elliptic problems. In Section 2, we specialize the result of 
Theorem 1 to obtain our basic result in Theorem 2. -The proof of Theorem 1 
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combines ideas from the writer’s paper [8], [10] and [11] with an extremely 
simple but ingenious remark made by Beals in [4]. 


Section 1. Let H be a Hilbert space with inner product (.,.), W 
another Hilbert space which is identified with a dense linear subset of H 
sgo that the injection map of W into H is compact. 


Definition (1.1). By an abstract elliptic boundary value problem for 
the pair {H,W} is meant the following: We give a Hilbert space T and 
continuous linear mappings A of W into H and y of W onto T such that 
for some constant c 


(1.1) lu lw S cf] Au la+ lu la+ | yu le} : 
for all u in W, while y =0 on a dense subset of H. 


Corresponding to each abstract elliptic boundary value problem in the 
sense of Definition (1.1), we may form two operators as follows: 


Definition (1.2). (a) (A,y) is the bounded linear mapping of W into 
HOT given by ’ 
(A, y) (u) = [Au, yu]. 

(b) A, is the densely defined linear operator in H with 
D(A,) = {u | we W, yu=0} 
Ayu = Au, u € D(Ay). 
Lemma (1.1). If {1,4} defines an abstract elliptic boundary value 
problem for {H, W}, then A, ts a closed linear operator in H. 
Proof of Lemma (1.1). For yu==0, the inequality (1.1) implies 
(1.2) lu [lw Sef] Ayu la+ [lu la} 


for ve D(A,). Hence if us € D(A,), u,>u in H, Ayo, it follows that 
“ou in W, uce W, yu>yu Au, Au: Hence yu=0, vem Au, ie. 
ue D(Ay), Ayu==v. Thus A, is closed. Q.E.D. 


Definition (1.3). Let {T,A,y} and {T’,A’,y’} be two abstract elliptic 
boundary value problems for {H,W}. Then we say that these two boundary 
value problems are formally adjoint to one another if 


(Ayu, v) == (u, A’ yo) 


for all u€ D(A,), vE D(A’y). 
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Definition (1.4). Let Q be a topological space, T a given Hilbert space, 
and for each w in Q, suppose we are given an abstract boundary value problem 
(T,A(w),y(o)} for {H,W}. Then this family of boundary value problems 
is said to be continuous tf the mapping 


o> (A(#),y(@)) 


is a continuous mapping of Q into L(W,H ®T), where the latter has the 
norm topology. 


Lemma (1,2). If {T,A,y} defines an abstract elliptic boundary value 
problem for {H, W}, then for each of the operators (A,y) and A, of Definition 
(1.2), tke nullspace is of finite dimension and the range is closed. The 
nullspace of Ay coincides with the nullspace of (A,y). 


Proof of Lemma (1.2). We note first that if Ayu = 0, then yu==0 and 
Au==0, i.e. wEN((A,y)) and conversely. For such u, we have by the 
inequality (1.1) 

(ulr Sc] u lz. 


Since the injection map of W into H is compact, the unit ball in N (4y) is 
pre-compact. Hence N (Ay) is of finite dimension. 
To prove that R(A,) is closed in H, we remark that for u€ D (4y), 


Iulwsectlula+ i Aye |a}. 


Hence the mapping J of the graph of A, into H given by J([u,4,u]) == u 
is compact. It follows by Lemma 1 of [9] that the range of Ay is closed in H. 
The same argument applies to (4, y). Q.E.D. 

Our basic result is the following : 


THEOREM 1. Let Q be a connected topological space, {T, A (u), y(o)} 
and {I,A (o), y (w)} two continuous families of abstract elliptic boundary 
value problems for {H, W}. Suppose that: 


1) For each ùo in Q, {T, A (w), y(@)} is formally adjoint to 
{T, A’ (o), Y(o)}- 
2) For a particular o; in Q, 


(A (wo) ) ta = ( (4 (wo) vn) *. 
Then: 


a) For every œw in Q, 


(A (o) Ir = ((A (w) Dey) *. 
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b) For every w in O, (A(o),y(o)) and (A’(w),y(w)) are Fredholm 
operators whose index does not depend on w tn Q. 


c) For each w in Q, (Alo))yin and (A’(o))y(w) are Fredholm 
operators. Hach index does not depend on w in Q. 


Index (A(w),y(w)) = index (A (0) )yw o€ R 


We shall obtain the proof of Theorem 1 as the culmination of a series 
of auxiliary results. We begin with the following: 


Lemma (1.3). Under the hypotheses of Theorem 1, the conclusion (a) 
implies the conclusions (b) and (ce). 


Proof of Lemma (1.3). If conclusion (a) holds, we have 


(4’ (w) Ivo) = (A (0) zo) ) a 


By Lemma (1.2), (A(o))4 (a) has a closed range and a finite-dimensional 
nullspace, as does (A’(w))y(a). Since the range of (A(o))yw is closed 
in H, its codimension equals the dimension of N((A(w)yw)*), ie. of 
N((A’(o) )y(w)), which is finite. Hence (A(w))(w) and (A’(w))y(a) are 
Fredholm operators. 

As we have already remarked in Lemma (1.2), 


N((A(e) wy) =N ((4 (o), y(o))). 


We know moreover that codim #(A,) =codim R((4,y)) for any abstract 
elliptic boundary value problem. Indeed, since y maps W onto T, there exists 
a bounded linear map S of T into W such that y8 =the identity on T. 
Then (4, y)u = [v,f] €H T if and only if 


(A, y) (u— Sf) = [v — Asf, 0], 
Ay(u— 8f) =v—ASf. 


Now suppose codim R(A,) ==r. Then there exist r elements {w,,w2,° + -, Wr} 
such that w€ R(A,) if and only if (w, w;) =0 for 1SjSr. By the above 
argument, [v,f] lies in R((A,y)) if and only if v—ASf lies in R(A,) i.e. 
if and only if 

(v—A5f, o) =0, 1SjSr 


Hence codim R((4, y)) <=r—codimA(A,). On the other hand, we R(A,) 
if and only if [w,0] € R((4,y)). Hence codim R(A,) S codim R((Ay)), 
and finally codim R(A,) = codim R (4y). . 
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It follows from the conclusion of the preceding paragraph that if 
(A (w))vi is a Fredholm operator, so is (A(#),y{)) and their indexes are 
equal. On the other hand, for w near œ, and for a given e> 0 


A (o),y(o)) (u) — (Alan), y (er) ) (u) lzer 
Sefu lE cef] u lla + | (A (),7(o1)) (u) laer}. 


I£ we choose e sufficiently small, it follows by a standard theorem on invariance 
of the index under perturbations small in the graph norm ([15]) that index 
(4 (w), y(0)) =index(4 (ox), y(01)). Hence the index of (A(w),7(o)) is 
locally constant in » and since Q is connected, the index of (A (w), y(w)) 
is constant. Thus index (A (o))y«w =index (A(),y()) = constant. If 
we apply the same argument to the adjoint problem (A’(w),y’(w)), we com- 
plete the proof of the lemma. Q.E.D. 

We now state and prove a simple but ingenious lemma due to Richard 
Beals ([4]). 


Lexma (1.4). Let T and T, be two closed Fredholm operators in H 
with TOT, Suppose that index T = index T,. Then T =T. 


Proof of Lemma (1.4). If TCT,, then N(T) C N(T,), R(T) C R(T). 
Hence index T = index T, and equality holds only if N(T) =N (T), R(T) 
=R(T,). Then, however, T == T. 


Lemma (1.5). Under the hypotheses of Theorem 1, the- set 


0; = {v | vE Q, (A’(w) )y(w) = (A() yw) *} 
ts open in Q. 


Proof of Lemma (1.5). For all » in Q, we have 
(L (u)r E (A (@) (ay) *- 


If œ € Q, then by the argument of the proof of Lemma (1.3), there exists 
a neighborhood N of œ in Q such that for o in N, (A()) yw) and (A’(w)) yo 
are Fredholm operators and their indexes are constant. Then on NV 


index (A (w) ) (a) —index( (A (w) yw) )*) 
— index (A (o) )(w) + index( (A (w) ) yw) 


is constant and equals 0 at w,. Thus 


| “index(A’(o) (w)) =index((Ae)y())*) _ 
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for w€ N, so that by Lemma (1.4) 

(4’(o) Jr Feen (A (w) y(w))* 
for w€ N. Hence NCQ, Q.E.D. 


Lemma (1.6). Let w>y(w) be a continuous mapping of Q into 
L(W,T) with the norm topology such that y(o) maps onto T for each o. 
Then there exists a continuous map S of Q into L(T,w) with the norm 
topology such that 

y(o)S, = identity on T 
for each w in Q. 


Proof of Lemma (1.6). For each » in Q, let y*(w) be the map of T 
into W adjoint to y(o). Since y(o) maps W onto T, y(w)* is one-to-one, 
has closed range in W, and has a bounded inverse defined on its range. Let 
Pa be the orthogonal projection operator of W in R(y(w)*). If w,€ Q, the 
mapping of R(y(w,)*) onto R(y(w)*) given by 


Kolu) =y (0)* (y (01)*)> (u) 


maps E(y(w:)*) one-to-one onto R(y(w)*), is norm-continuous in w on Q, 
and reduces to the identity map for w == w. , 

We now assert that Pa is norm-continuous in w on Q. It suffices to 
establish this continuity near œw, for a given but arbitrary w,.in Q. Let 
u€ W. Then Pau lies in R(y(w)*) and by the remarks of the preceding 
paragraph, there exists an unique u, in R(y(w:)*) such that 


Kol = Pt. 


To show that Pu is norm continuous at w, it suffices to show for e>0 that 
there exists a neghborhood N of œ, in Q such that for w in N, || to — te, lw <e 
for all u in W with [u||=1. We know however that u, > Pu and that 
for vE Q, 

u — Kathy € R(y(w)*)L 
i.e. 
(1.3) (u — K otio, Kuv) = 0 


for all v in R(y(o)*). Let J be the injection map of R(y(%)*) into W, 
so that J* mapping W into R(y(%1)*) coincides with the orthogonal pro- 
jection Pa, Since Ky is norm-continuous, Ko == J -+ Ra, where || By || 0 
ag a—>o, Hence K,t— Pa, + Bu*, where | Ro | = | Ro | —>0 as ow. 
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The equality (1.3) holds for all v in R(y(w,)*) if and only if Ku* (Kot) 
== K „tu, i.e. if and only if 


Us + Pu Rothe + Ro%J uu + Ba* Rotts = Pou + Rtu 
We remark that if || Ro || = || R«* | < 8, then 
| to l SS [u {1 + 8} + (28 +) | to | 
so that choosing ô sufficiently small we have 


| wo || S2 lul] E? 
for |u| 1. Then 


|| to — tto | = || tto — Pot | 
S || Ra | +2 | Ro* | +2 || Ro || | Ro* | +2 0 R* | 
<= 58+ 28%, 
If we choose ô > 0 so small that 58+ 28 < e, we have verified that ta is con- 
tinuous in w on Q uniformly for all u with |u] 51. 
For w€ Q, define Ty: W>T by Tuu = (y(o)*) (Pau). Then Tau is 
well-defined for each u, and if v=y(w)*v, then 


To(ylo)*v) = (y(o)*)*(y(o) *0) =v, 
ie. 
Toy(o)* identity on I. 
However, 
y (o) *{ (y (01) *) ta} = Pau 


so that To(u) = (y(wı)*) (uv). It follows immediately that Te is a bounded 
linear operator for each » in Q and that the map „> Ta is continuous from 
Q to L(W,T) in the norm topology. 

Finally, set Su =Tu*: T>W. Then o— 8, is continuous from Q to 
L(T,W) in the norm-topology and 


¥(@) Su = y (v) Tu* = (Tay(o)*)*=Ir. Q. E. D. 


Lumma (1.7). Let {T,A(w),y(w)} be a continuous family of abstract 
elliptic boundary value problems for {H, W}. For each w in Q, let cy be 
the least constant such that 


lu llw S co{lu la+ | A(o)e at | y()u Ir} 
for all u in W. 
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Then for each o, in Q, there is a neighborhood N of œ in Q such that 
Cy 18 bounded on N. 


Proof of Lemma (1.7). By assumption, there exists a constant c such 
that 
lu lw S c{l u lat 1 Ao) iat | y(o)e Ir}. 
Hence 
|| u lw cilula+ 1Ale)a llat I (4 (01) —4A (0) )u la 
+l y(o)u r+ 1G (1) —y(o))u lr} 
Sc{lula+ | A()ullat | y(e)ulr} 
+ €(o) |] u Ir : 
where «(w)—>0 as w—>o,. Choosing N so small that «(w) <4, we have 
tu Z 2c on N. Q.E.D. 


Lemma (1.8). Under the hypotheses of Theorem 1, if 
Qı == {w | v € Q, (A (o) Jy = (A(w)yia))*}; 
then Q ts closed in Q. 


Proof of Lemma (1.8). Let w, be a point of the closure of ® in Q. 
We wish to show that w, lies in Q. 


Applying Lemma (1.7) and restricting our attention to a suitably small 
neighborhood of w, in Q, we may assume without loss of generality that there 
exists a fixed constant c such that for all u in W, 


lu lw cfl u la+ Alou lat | y(@)e |r} 


and 
ulr Sef u la+ 14 (o)u lat lYy(oJulm} 
for all œ in Q. 


Let u be an element of D((A(o,)y«,)*) and let w— (A (1) (co) ) *U. 
Then for all v, in W with y(w,)v,—0, we have 


(u, A (%1)0) = (w, 01). 


Let wE Q, veD((Alo))yw). Set vı = v — Say (01) V, where Sy is the con- 
tinuous family of right inverses for y(w) whose existence was proved in 
Lemma (1.6). Then y(o,) (1%) =.0; and we have 


(1.4) (u, A (01) (v — Sory (or) ¥)) = (0,9) — (w, Jory (01) 0). 
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We rewrite equation (1.4) as follows: 
(u, A (o)v) = (w,v) + (u, (A(w) —A(o:))¥) 
+ (u, A (01) Se, (y (er) —y(@) )¥) + (w, Sen (y(o) —y(e)) 9). 


Consider the sum 
8(v) = (u, (A (o) —A (w1) )v) + (w, Saly (o) —y(or)) 2) 
+ (u, A (1) 8, (y(e) —y (o) Jv). 


Using the continuity of A (w) and y() in œ near w, we have 
[s(v)| Se(o) {lu la lv w+ lv lalo lw} 


where e(o) —> 0 as v—> œ, independently of u, v, or w. 


(1.5) 


(1.6) 


Since y(w)v= 0, we have 


|v lwSe{l vat |A(o)v la}. 
Thus 
| 3(v)|Sce(o) {hu la+ l w la} {Il o la+ | A(o)2 |e} 


The linear functional s(v) of [v,A()v] on the graph of (A(w)) yw) is 
therefore bounded with a bound S ce(w) {|| u la+ || wla}. We may extend 
this functional to a linear functional on H @ H with the same’ bound, i.e. 
there exist elements u, and w, of H with 


(La [Aa + 100 [3ni E cefo) {lu lla + fe ba} 
ch that oral wie Ww y(w)o—=0, 
(1.7) s(0) = (wå (w)¥) + (wat). 
Substituting equation (1.7) in equations (1.5) and-(1.6), we obtain 

(u, A (u)v) — (1,0) + (tas A (w)9) + (100) 9) 
for all ve D((A(w)) ya). Thus, 
(1.8) (u, A (w)0) = (w+ wa 9). 
Tt veda only w lying in Q., equation (1.8) implies that 
u— uE D((A'(w)) yew) | . 

ie. u—=us€ W, y (o) (u— us) — 0, and 
(1.9) A’ (w) (u— tia) = (W + 2e) 
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We know that 


lu — u |w S c{|u— u la + | A’ (o) (u— uo) la} 
S c(| u— to la + lw+ ws la} 
Sc{|lula+ | w lz} (1 + 2ce(o)). 


Thus the set of elements {u — u, | w € Q1} is bounded in W and the inter- 
section of this set with the filter of neighborhoods of w; is itself a filter base. 
By the weak compactness of closed balls in W, there exists an element uo of 
W which is an adherent point of the corresponding filter in the weak topology 
on W and hence in the strong topology on H. Since || uol] —>0 as w— w, 
u—us—> uin H. Hence u==u, and u lies in W. Furthermore by the weak 
compactness of bounded closed sets and the uniqueness of the adherent point 
Uo, U —Un>u weakly in W as o> w. 

Since y’(w) > y'(o,) in uniform norm as wo, while vw > 
boundedly and weakly in W, it follows that , 


y (o) (u— tu) > y (o1) 0 


weakly in T. However, y (w) (u— uw) ==0 for all w in Q, so that y (w, )u = 0. 
Hence D((Alar))*rm) C D((A (01) rw) and since (A (o) )yen) is a 
restriction of (A (w1) ) *yiaun, it follows that 


(A (o1) yay) * = (A (02) ) yop Q. E. D. 


Proof of Theorem 1. By Lemma (1.5) Q, is open in Q. By Lemma 
(1.8), Q, is closed in 2. Since Q is connected and wọ lies in Q,, it follows 
that N =Q, i.e. 

(A (o) Ir = (A (o) yw) * 


for all w in Q. Q.E.D. 


Section 2. Let X be a precompact manifold with boundary, Y its boun- 
dary, B a differentiable complex vector bundle over X. We may assume 
without loss of generality that X is differentiably imbedded in a compact 
manifold X, and that B is the restriction to X of a differentiable vector bundle 
B, over X,. We suppose given a Hermitian structure on the fibres of B, 
and a differentiable measure „ on X,. Following the discussion of Section 2 
of [10], we may then form: 


E(B) =the family of infinitely differentiable sections of B; 
D (B) = {u | uc E(B), Supp(u) is a compact subset of the interior 
of X}; 
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D’(B)—the family of distribution sections of B; 
I*(B) — the Hilbert space formed from the measurable sections of 
of B, square-summable with respect to a; 
W3(B) =the space of sections of B with square-summable deriva- 
tives of order Sm. 


(For the precise definitions, we refer to [10]. Note that the injection map 
of W™?(B) into L?(B) is compact under our hypotheses, [25].) 

If A is a linear differential operator of order m in B,, then if we restrict 
A to B, we see that A defines a bounded linear mapping of W™*(B) into 
D*(B). 


Definition (2.1). By an elliptic boundary value problem of order m 
on B, we mean a triple {A,T,y} conststing of: 


(1) A continuous linear mapping A of W"*(B) into L?(B); 
(2) A Hilbert space T; l 
(8) A continuous linear mapping y of W"(B) onto T such that 


{u | uc W™3 (B), yu =0} is dense in L? (B); 


and satisfying the basic condition: There exists a constant c> 0 such that 
for all u in W"2(B), 


(2.1) lu llyma) Sof | u lzm + | Au | + | ye Ir}. 


In the terminology of Section 1 of the present paper, an elliptic boundary 
value problem of order m on B is simply an abstract elliptic Br value 
problem {T,A,y} for {T> (B), w"2(B)}. 


Definition (2.2). The boundary value problem {A,T,y} is satd to be 
proper tf yu==0 for al u in D(B). It is said to be local if TC D’(B,) 
where B, is a vector bundle over Y and y is a local operator, (i.e. with 
Supp(yu) C Supp(u) for we €(B)). 

The class of local elliptic boundary value problems where A is an elliptic 
differential operator has been studied intensively in recent years (cf. Chapter 
X of [16] for a brief development of basic results). This discussion has been 
extended also to semi-local problems, i.e. where A and y are given by differ- 
ential operators with singular integral operators as coefficients (see [2] for 
a summary of results). 

We apply the results of Section 1 in a slight reformulation to obtain a 
general result which (as we shall show elsewhere in detail) is very useful 
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in answering the following two types of questions for non-local eliptic 
boundary value problems : 


(I) If (A,y) is the mapping of W™?(B) into L'(B) BT given by 
(A, y) (u) = [Au, yu], 
then is (A, y) a Fredholm operator? 
(II) If A, is the closed densely defined linear operator in L? (B) with 
D(A,) = {u | we W"?(B), yu —=0}, 
Ayu = Au, u € D (47), 


and tf {A’,T’,y’} is another elliptic boundary value problem which is formally 
adjoint to {A,T,y} in the sense that 


(Au, v) = (u, A’v) 
for ve D(A,), ve D(A’), then is it true that 
Aly om (Ay) *? 
To present our general result, we follow Section 1 to define: 


Definition (2.3). Let Q be a topological space and for each w in Q, 
let {(A(w),T,y(w)} be an elliptic boundary value problem of order m on. B 
with a ficed Hilbert space T. Then this family of elliptic boundary value 
problems is said to be continuous if the mapping f of Q into L(W™?(B), 
L?(B) OT) given by f(w) (u) = [A(o)u,y(o)u], is continuous from Q to 
the uniform topology on L(W™? (B), L’ (B) T). 


THEOREM 2. Let Q be a connected topological space and let 
A(w),T,y(#)} and {A (0), y (o)} 


be two continuous families of elliptic boundary value problems of order m 
on B such that for each œ in Q, {A (o, T, y(o)} is formally adjoint to 
{4 (o), I’, y/(w)}. Suppose further that there exists wọ in Q such that 
(A (wo) Jarco = ( (A (wo) Iran) *- 


Then 
(a) For all w in Q, 


(A’ (w) Jri) = (4 (©) x) ) as 
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(b) (A(w),y(o)) and (Alo))y are Fredholm operators for all w 
in Q. Their indexes are equal and independent of w tn Q. 


Proof of Theorem 2. This is just the. specialization in our present 
context- of Theorem 1 of Section 1 with H = L? (B), W = W™?(B). 
Q. E. D. 
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. ON THE STRUCTURE OF COMPACT COMPLEX ANALYTIC 
SURFACES, I. 


By K. Koparra. 


The present paper is a continuation of a series of our previous papers 
[8], [9]. The main results of this paper were announced in two short notes 
[10], [11]. i 

We call a compact complex analytic surface free from singularities 
simply a surface. In our previous paper [8], we have shòwn that any 
surface with non-constant meromorphic functions is either an algebraic surface 
or an elliptic surface and, in [9], we have examined the structure of elliptic 
surfaces in detail. 

In Section 1 of the present paper we establish certain relations between 
several numerical characters, e.g., the geometric genus, the irregularity, the 
Betti numbers, . . . of a surface (Theorem 3). In Section 2 we derive some 
sufficient conditions for surfaces to be algebraic or elliptic. In particular 
we prove that a surface with an even first Betti number is algebraic if its geo- 
metric genus vanishes (Theorem 10). Following A. Weil we define K3 surface 
to be a regular surface of which the first Chern class vanishes. In Section 5 
we prove a theorem to the effect that every K3 surface is a deformation of a 
non-singular quartic surface in a projective 3-space (Theorem 13). This 
theorem has been conjectured earlier by A. Weil and independently by A. 
Andreotti (compare Grauert [5]). In Section 3 we examine those surfaces 
which have no (non-constant) meromorphic functions. By a theorem of 
Grauert [6], any surface is obtained from a surface containing no exceptional 
curve (of the first kind) by means of a finite number of quadric transforma- 
tions. Hence, in order to study the structure of surfaces, it suffices to 
consider surfaces containing no exceptional curves. We prove that, if a 
surface containing no exceptional curve has no meromorphic function, then 
it is a complex torus, a K3 surface or a surface of which the first Betti 
number is 1 and the geometric genus is zero (Theorem 11). In Section 6 
we show that a surface with a trivial canonical bundle is a complex torus, 
a K3 surface or an elliptic surface of the form C?/@, where C? denotes the 
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space of two complex variables and G is a properly discontinuous non-abelian 
group of affine transformations of C? (Theorem 19). Finally, in Section 7, 
we introduce a classification of surfaces (Theorems 21 and 22). We prove 
that a surface is a deformation of an algebraic surface if and only if its first 
Betti number is even (Theorem 25). 

The proof of our resulis is based on the Riemann-Roch-Hirzebruch 
theorem of which the complete form has been established recently by Atiyah 
and Singer [2]. 


1. Numerical characters. By a surface we shall mean a compact 
complex analytic surface free from singularities. Throughout this paper 
we denote by S a surface. In this section we shall establish certain relations 
between several numerical characters, e.g., the geometric genus, the irregu- 
larity, the Betti numbers, . . . of a surface.. 

We denote by b, the »-th Betti number of § and by c, the y-th Chern 
class of 8. Moreover, for any sheaf Z over 8, we denote by H’(8,&) the v-th 
cohomology group of S with coefficients in =. We represent any cohomology 
class c€ H*(S,Z) by the value c(S) of c on the fundamental cycle of the 
surface O oriented in the natural way with respect to its complex structure, 
where Z denotes the ring of (rational) integers, and we write c for c(8). 
Thus we consider c,? and c, as integers. We denote by © and Q" respectively 
the sheaves over $ of germs of holomorphic functions and of holomorphic 
r-forms. We define . 

hr” == dim H” (8, 9°), = 6. 


By the duality theorem h? is equal to h*°. We set 
P= 12:3 m 29, q= hht, 


and we call p, and q respectively the geometric genus and the irregularity 
of 8. ; 

Let R denote the field of real numbers. In view of de Rham’s theorem 
each element of H°’ (S, R) is represented by a real d-closed 2-form defined 
on S. For any real d-closed 2-forms ¢ and y on S we define 


Senn 


The integral (éņ) represents the cup product of the cohomology classes of 
€ and of y. Hence we may consider (éy) as a non-singular symmetric bilinear 
form defined on the linear space H?(S,R). We define b+ and b to be 
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respectively the numbers of positive and of negative eigen-values of the 
symmetric bilinear form (én). 

We write 6,(9),A""(8),p,(8),- ° for b, h”, pg: - + when we want 
to make explicit that they are numerical characters of the surface 8. 

Let @* denote the multiplicative sheaf over S of germs of non-vanishing 
holomorphic functions. We have the exact sequence 


0>Z> 6 > 6*->0 


and the corresponding exact cohomology sequence 


(1) <- -> H(8, 6) > (8, 6°) (89, Z) -> (8, 0) > p: 


Each element F of H1(8,6*) represents a complex line bundle over 8. 
The Chern class c(F) is, by definition, the image 8*F of F in H?(8,Z). 
For any complex line bundle F over S we denote by Ö(F) the sheaf over 
9 of germs of holomorphic sections of F. In the case of complex line bundles 
over surfaces, the Riemann-Roch-Hirzebruch theorem can be formulated as 
follows: 


(2) È (-1)" dim H?(8, 6(F)) =4 (e + ac) +2 (a+ 0), c= 0(F) 


(see Atiyah and Singer [2], Hirzebruch [7]). Hence the following formula 
of Noether follows: 
(3) 12(py— +1) = 6° + Co 


In what follows we shall employ the notation of our previous paper [8] 
for linear systems of divisors. Thus, letting F be a complex line bundle over 
8, we denote for any holomorphic section o of F the dwisor of o by (e), 
provided thate does not vanish identically, and define | F | to be the complete 
linear system consisting of all divisors (o), «€ H°(8,6(F)), o>£0. More- 
over we denote by K the canonical bundle of S. We have 


dim | F | =— dim H°(8,6(F))—1. 
Hence, using the duality theorem, we obtain from (2) the Riemann-Roch 
inequality . : 
(4) dim|F|+dim|K—F|=4(e+ac)+p,—q—1, c==c(F). 


We denote by (21,22) a local coordinate (not specified) on 8. Since 8 is 
oriented in the natural way, the volume element dz, A da, A di, N da is 
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positive. Hence, for any differential form y—y.dz, A da, on 8 ‚which does 
does not vanish identically, we have 
(5) f ¥AYy>o. 
Trrorem 1. Every holomorphic 1-form defined on a surface ts d-closed. 
Proof. Let p denote a holomorphic 1-form defined on S. We have , 


f, æ na f al K a) =o. 
Comparing this with (5) we conclude that dẹ vanishes identically. 


THEOREM 2. Let 8,6%° ' ',$r be holomorphic 1-forms defined on 8. 
If 81° ' +> ¢n are linearly independent, then the d-closed 1-forms ¢1,° `<; $a, 
iy’ * *, $y are d-cohomologically independent. 


Proof. Assume that 


(6) api > + ++ aapa + Bid ++ + + Bada di, 


where the coefficients a1,: - -,@,, Bu’ ° *,8x are constants and » denotes a 
continuously differentiable function defined on S. For any point z on 9 we 
find holomorphic functions f; defined on a neighborhood of z in 8 such that 
df; = pġ; We have 


p= afit: e H anfa t+ Baat + Bafa + constant. 


This shows that » satisfies the mean value theorem with respect to any 
sufficiently small “sphere” in 8. Hence „ is reduced to a constant and 
consequently 
(7) Obit tat, Bidit- Hd. 
Thus we see that the d-cohomological relation (6) is equivalent to the linear 
relations (7), q.e. d. ent 
Let € denote the field of complex numbers. We have the exact sequence 
d . 
0>C>6 —d6->0 
and the corresponding exact cohomology sequence À 
(8) 0- H° (8,40) > H'(8,C) > H(8,6)->- 
Hence we get the inequality 
. | qZ bı—dim H°(8, 46). 
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On the other hand we infer from Theorems 1 and 2 that 
(9) hi = dim H° (8, dO) < $b.. 
Consequently we obtain 

(10) g>b,—hw> pbi 


Moreover we have the inequality 


(11) bt = 2p; 


In fact, in view of (5), we can choose p; holomorphic 2-forms yy, J == 1,2, 
‘Pp such that 


Ete i Su N em dir. 
Hence, setting : 
naa = Wy + Wy, nas == tah; — thy, i= et 2 
we obtain 
(nme) = Bjk for j, k= 1,2, > +, pp 


This proves the inequality (11). 

_ By the Hirzebrach index theorem (see Hirzebruch 71) we Bayer 
(12) 3b — 3b- = 6,2 — 20. 
Combining this with (3) and using the identity 


C2 == 3 — 2b, + bt + 5r, 
we obtain 

2q — bı + b*— 2p = 1, 
while, by (10) and (11), the integers 2q—b, and bt— 2p are both non- 
negative. Hence we conclude that 2q is equal to either b, or b+ 1 and 
that b+ is equal to 2p + 1 or 2p, according as 2q == b, or =b, +1. Thus 
we obtain the following 


THEoREM 3. If b, is even, then 2q == b, 2p = bt— 1 and h =q. 
If b, is odd, then 2q =b, + 1, 2p = b* and b! =q — i. 


COROLLARY. The numerical characters 2,(8), q(S) and 120 (8) are 
homological invariants of the surface 8. 


We obtain from (3) and Theorem 3 the formula 


, 7 109, +9 if b, is even 
2 8 b u | g 1i 3 
(13) PT 109, + 8, if b, is odd. 
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Bine by Theorem 3, b, =h"" + q, we infer from (8) and (9) the exactness 
of the sequence 


(14) 0 H°(8,d6) > H*(8,C) > B'(8, 0) > 0. 


Now we consider the case in which the first Betti number b, of $ is 
even. By the above results b; ==2g, h°==q and there exist q linearly 
independent d-closed holomorphic 1-forms ¢1,¢2,- * `, pa defined on 8. Let 
{yu Y2" © '»Yag} be a Betti base of 1-cycles on S and let 


Op |] dy. ; 

Yi . 
Moreover let C2 denote the space of g complex variables. By Theorem 2 the 
d-closed 1-forms ¢1,° ' -,¢¢,¢1,° `, $a form a base of the d-cohomology 
group of 1-forms on 8. Hence the vectors 


oy = (o typ" * gj), j= i,2,: 742g, 


are linearly independent over R and generate a discontinuous subgroup D 
of the vector group Ca. We call the compact complex analytic group variety 

Q C/D the Albanese variety attached to the surface 9 and define a 
holomorphic map ® of K into Q by the formula 


(16) fin, f 9) (mid). 


For any 2-cycles T and A on a surface we denote by (TA) the inter- 
section multiplicity of T and A and write (I°) for (IT). An ezceptional 
curve (of the first kind) on a surface is, by definition, a non-singular rational 
carve C with (C?) ==—-1. For any point w on a surface W we denote by 
Qu the quadric transformation of the center w. The quadric transform 
Qw(W) of W is a surface and the total transform Qu(w) of w is an excep- 
tional curve on Q»(W). It has been shown by H. Grauert that, conversely, 
if C is an exceptional curve on a surface 8, then there exist a surface W 
and a point we W such that S=Q.(W) and C==Q,(w) (see Grauert [6]. 
For an elementary proof of this result, see Kodaira [9], II, Appendix). 
Consequently any surface is obtained from a surface containing no excep- 
tional curve by means of a finite number of quadric transformations. 

The numerical characters b, and b+ of a surface are invariant under 
quadric transformations. Hence, by Theorem 3, the geometric genus p, and 
the irregularity q of a surface are invariant under quadric transformations. 
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2. Algebraic and elliptic surfaces. By an elliptic surface we shall- 
mean an analytic fibre space of elliptic curves over a non-singular algebraic 
curve, i.e., a surface S together with a holomorphic map ¥ of S onto a non- 
singular algebraic curve A such that the inverse image W*(u) of any general 
point u€ A is an elliptic curve. We call A the base curve of the elliptic 
surface &. 


THEOREM 4. If there exist on S two algebraically independent mero- 
morphic functions, then S is an algebraic surface. If there exists on 8 one 
and only one algebraically independent meromorphic function, then S is an 
elliptic surface (see Kodaira [8], Chow and Kodaira [3]). 


If there exists on S a complex line bundle # which has at least two 
linearly independent global holomorphic sections o, and o, then the quotient 
o/o ig a non-constant meromorphic function on S and, consequently, S is 
either algebraic or elliptic. Thus we obtain the following two theorems: 


` Treorem 5. If there exists on S a complex line bundle F such that 
dim | F | >1, then 8 is either an algebraic surface or an elliptic surface. 


THEOREM 6. If p(8) 22, then S is either an algebraic er or an 
elliptic surface. , 


THEOREM 7. If h+°(S) = 3, then 8 is either an algebraic surface or 
an elliptic surface. 


Proof. By hypothesis there exist at least three linearly independent 
holomorphic 1-forms &ı, $z, $s defined on S. If the holomorphic 2-forms 
$: A $ı and ds A ġı are linearly independent, then, by Theorem 6, 8 is 
either algebraic or elliptic. On the other hand, if there is a non-trivial linear 
relation 


ads A $i + Bos A $1 = 0, 
where g and 8 are constants, then we have 


ads + Bos = fdr 


Thus we obtain a non-constant meromorphic function f defined on re Hence 
8 is algebraic or elliptic. 


THEOREM 8. If. there esists on S a complex line bundle F with 
c(F)*>0, then 8 is an algebrate surface. 
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Proof. Since by hypothesis, c(F)? is a positive integer, for any suffi- 
ciently large integer m, we obtain from (4) the inequality 
dim | mF | + dim | K — mF | = 4c(F)?m?. 


This shows that either |mF| or |K—mF'| contains positive divisors. 
Let Dm denote one of these divisors. Then, for all sufficiently large integers 
m and n, we obtain 

(16) dim | nD, | Z 4e (F) nèm. 


Combined with Theorem 5 this proves that § is either algebraic or elliptic. 

Suppose that 8 is a non-algebraic elliptic surface. Then all meromorphic 
functions on S are induced from meromorphic functions on the base curve 
A of S (see Kodaira [8], §4). It follows that, for any divisor D on & and 
for any positive integer n, the inequality l 


dim | nD | San 
holds, where a is a constant. This contradicts (16), q. e.d. 
Since c, = c(— K), we obtain from Theorem 8 the following 
THEOREM 9. Tf à? (S) > 0, then 8 is an algebraic surface. 


THRoREMm 10. If b,(S) is even and if p,(S) vanishes, then 8 is an 
algebraic surface. 


Proof. Since b, is even, the vanishing of p, implies, by Theorem 3, 
that bt==1. There exists therefore a cohomology class c€ H?(3,Z) with 
c>0. Since H?(S, O) vanishes, we infer from the exact sequence (1) the 
existence of a complex line bundle F over S with c(F) =c. Hence, using 
Theorem 8, we conclude that $ is an algebraic surface. 


3. Surfaces with no meromorphic functions. A surface is said to be 
regular if and only if its irregularity vanishes. 


Definition. By a K3 surface we shall mean a regular surface of which 
the first Chern class vanishes. 


In case $ is regular, the exact sequence (1)-is reduced to 
(17) 0 A’ (8, 6*) > H? (S,Z) > HE (8, 6) >: -- 


and, consequently, each complex line bundle F over § is determined uniquely 
by its Chern class c(#). In particular, the canonical bundle of $ is trivial 
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if and only. if the. first Chern class c, of S vanishes. Hence a regular surface 
is a K3 surface if and only if its canonical bundle ts trivial. 


TEXROREM 11. Assume that there exists on S no meromorphic function 
except constants and that S contains no exceptional curve. Then the irregu- 
larity q of S is not greater than 2. If q ts equal to 2, then S ts a complex 
torus. If q ts equal to 1, then the first Betti number b, of S is equal to 1 
and the geometric genus p; of S vanishes. If q is equal to 0, then 8 is a 
K3 surface. 


Proof. In view of Theorem 6, the geometric genus p, of S is equal to 
either 1 or 0. In case pp=1 we denote by y a holomorphic 2-form on 8 
which doés not vanish identically. The divisor (y) of y is a canonical 
divisor. . We then denote by K the canonical divisor (y) instead of the 
canonical bundle. Moreover, if K 540, we write 


K = pa k,C,, 


where the C, denote the irreducible curves on S and the coefficients k, are 
positive integers. 

Lemma 1. If pl, then c,2=0. If, moreover, K 340, then the 
virtual genus «(C,) of each irreducible component O, of K is equal to 
either 1 or 0 and 
(18) (C,?) — 2r (0,) —2. 


To prove this lemma it suffices to consider the case in which K +40. 
We have the equalities i 
(19) (C,?) + (KC,) = 2r (0,) —2, 


(20) (KC,) =k,(C,*) +2 ka (C0). 
Hence we infer that (KC,)=0. In fact, if (KC,) <0, then, by (20), 
(C) <0 and therefore, by (19), (C,?) =—1, r(C,)=0. This contra- 


dicts the assumption that S contains no exceptional curve. Now, in view 
of Theorem 9, we have 


È k, (KC,) = (K*) = a? <0. 
Hence we obtain 
7 =], (KO) = 0, 
and therefore, by (19) and (20), 
2a (Cy) —2 = (0/7) S0. : 
Consequently +(C,) is equal to 1 or 0. 
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A) The case in which b, is even. It follows from Theorems 3; 6, 7 
and 10 that bı = 2g, q =h 2 and p =]. 


i) h=? is equal to either 2 or 0. In fact, if h*° were equal to 1, the 
the Albanese variety @ attached to S would be an elliptic curve and non- 
constant meromorphic functions on @ would induce non-constant meromorphic 
functions on 8. This contradicts our hypothesis. 


ii) In case g== h>? =— 2, there exist on S two linearly independent 
holomorphic 1-forms ¢, and œa. Since there exists on S no meromorphic 
function except constants, the linear independence of ¢, and ¢, implies that 
the exterior product ¢: A $s does not vanish identically. Hence ‘the holo- 
morphic map & defined by (15) maps S onto the Albanese variety @. We 
infer in the same manner as in the proof of Theorem 5.3 in our previous 
paper [8] that ® is a biholomorphic map of S onto Q. Ponsegnentiy 8 is a 
complex torus. 


iii) Since 2,1, it follows from the above Lemma 1 that c,? =m 0, 
while, in view of Theorem 5, dim|2K| is non-positive. Hence, in case 
=0, we obtain from (4) the inequality 


dim |—K|=—dim|2K|>0. 


This proves that the effective divisor K vanishes and, consequently, S ts a 
K3 surface. 


B) The case in which b, is odd. It follows from Theorems 3, 6, Y and 
9 that bı =2¢g—1, q= h +1, born, AOS, 9, Sl and a? 0. 


i) Suppose that At°—:2. Then there exist on S two linearly indepen- 
dent holomorphic 1-forms ¢, and s, g==3 and b, =. Since there exists 
on $ no meromorphic function except constants, ¢1 A $: does not vanish 
identically. Hence pp == 1 and therefore, by Lemma 1, ¢,2==0. The formula 
(13) then proves that b ==-—6. This is a contradiction. 


ii) Suppose that A*°-=1. Then there exists on S a d-closed holo- 
morphic 1-form ¢ which does not vanish identically, q == 3' and b,=3. If 
Py = 1, then we choose a holomorphic 2-form y on 8 such that 


fonii 
and let i 
my +ý, y = ty — ih, fom V—1. 
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By a (r,s)-form we mean a differential form of type (r,s). For any 
1-form r we denote by r, and by 7, respectively the component of r of type 
(1,0) and of type (0,1). Now we prove the existence of a d-closed 1-form 
oon S such that $,6 and o generate the d-cohomology group of 1-forms on 
S and such that 


(21) doo = $ A $ 
Let 


E= ip AG. 


Obviously é is a real d-closed 2-form on 8. Since 


S,onsnengef, srnsryao, 
we have 


(5) = (én) = (em) = 0, 


while bt==2p,, py==1 or 0 and, in case pp—=1, (nm) = 28, for j, k= 1,2. 
Hence we infer the existence of a real 1-form p on S such that 

(22) dp =E= ip Ad. 

b, is equal to 3 and, by Theorem 2, ¢ and ¢ are d-cohomologically independent. 
Hence we can choose a O”-differentiable real d-closed 1-form r on 8 such 
that &, & and r generate the d-cohomology group of 1-forms on 8. With 
the aid of the Dolbeault isomorphism (see Dolbeault [4]) we infer from the 
exact sequence (14) that $ and r, generate the ĝ-cohomology group of (0,1)- 


forms on 8. It follows from (22) that 0,—0. Hence we find constants 
a, b and a C” -differentiable function A on S such that 


ip. = a$ + bry + OA. 
We define 
om oy +o, Co = —tp + ah + br + dà. 
Clearly oo is a (1,0)-form and 
do = — îidp = & A ¢. 
We have 
a= ag + ag + (b+ b)r -+ dp, p= +i. 
Thus o is a real d-closed 1-form on S. To prove that ¢, 5 and o are d- 


cohomologically independent it suffices to verify that b-+-5540. Suppose 
that b-+5=0. Then we obtain 


To= Ag + Op 
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and consequently 


$ A $= doo = 842. 
The function » attains its minimum at a point o on 8. The integral 
w(z) = (s gives a holomorphic function w == w(z) defined on a neighbor- 


hood of o in 8. We have _ 

60 (| w |?+- p) — 0. 
Hence |w |?-+ is the real part of a holomorphic function and satisfies the 
mean value theorem with respect to any sufficiently small sphere of the 


center o, while l 
| w(2) = |w) =o, u) = p(o). i 


Consequently w vanishes identically. This contradicts the assumption that 
$20. Thus we see that ¢, @ and o generate the d-cohomology group of 
1-forms on 8. 

Let W denote the universal covering of the surface S. The 1-forms ¢ 
and o induce 1-forms on W. We use the same symbols ¢ and a, respectively, 
to denote those induced 1-forms. By integrating ¢ we get a holomorphic 
function w, on W such that dw,—¢. It follows from (21) that 


d (co + 4) ome 0. 
Hence oo + %1$ is a d-closed holomorphic 1-form on W. Integrating this 
1-form we get a holomorphic function w, on W such that dw, == r, + tẹ. 
Thus we obtain a pair of holomorphic functions w,, wp on W satisfying the 
simultaneous differential equations 

dw, = ¢, 


(28) | dW, = oo + 1,9. 


We denote by G the group of covering transformations of W over 9. 
For any function f—f(w) on W, where w denotes a “variable” pras on 
W, and for any covering transformation g€ G, we define 


(gf) (w) =f (gw). 
We infer from (23) that 
d(gw, —wı) = 0, 
d(gwı—w:) = (gü, — Dı) du. 
Hence we obtain the formula 
gw: = 0, +4, 
7 | 
er gW = W: + GW, -F P, 
where «œ and £ are constants depending on g. 
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The exterior product dw, A dw, does not vanish identically. To prove 
this we suppose that dw, A dw, vanishes identically. Then we have 


dw, =f dw, 
where f is a meromorphic function on W. Using (24) we get 
(25) gj =f +. 


Tt follows that df is a meromorphic 1-form defined on 8. Since df A dw, 
= ddw, == 0, we have 
df = k dw, 


where k is a meromorphic function on 8S. Hence k is reduced to a constant 
and therefore 
f = kw, + constant. 


Combined with (24) and (25), this proves that kw,—#, is a function 
defined on 8. This contradicts the d-cohomological independence of ¢ = dw, 
and ¢== dij, Thus we see that 


dw, A dw, = > A To 


is a holomorphic 2-form on $ which does not vanish identically. It follows 
that p= 1. 

Next, we shall prove that dw, A dw, does not vanish at each point on 8. 
Suppose that the divisor K of dw, A dw, is not equal to zero and write 


K=>4,0,. 


Then, by the above lemma, the virtual genus +(C,) of each irreducible curve 
C, is equal to 1 or 0. Hence O, is either a non-singular elliptic curve or a 
rational curve possibly with a singular point. 

The function w, is constant on C,. To prove this we suppose that w, 
is not constant on C,. Then dw, induces on C, a holomorphic 1-form which 
does not vanish identically. Hence C, must be a non-singular elliptic curve. 
We denote by U, a connected component of the inverse image of C, in W 
and consider w, and w, as functions on U, by restricting their domains. 
Then we have 

dw, = f dw, 


where f is a holomorphic function on U,. Using (24) we get 
ir 
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Hence df is a holomorphic 1-form on C, and therefore 
af = k dw, 


where k is a constant. It follows that kw, — %, is a function defined on Cy. 
This contradicts the d-cohomological independence of dw, and dw, on Op. 


The function we is constant on C,. To prove this we suppose that we 
is not constant on C, and derive a contradiction. Since w, is constant on C, 
we infer from (28) that dw, induces on C, a holomorphic 1-form which 
does not vanish identically. Hence C, is a non-singular elliptic curve. We 
take a 1-cycle y on C, such that 


SS, dw +.) 0 


and choose a Betti base {y1, Ya; ys} of 1-cycle on S such that y is homologous 
to my, with respect to rational coefficients, where m is an integer 540. Then 
we have 


(26) dm! f dw, == 0. 
Ys Y 
Let 


om f $, for j= 1,2. 
Ys 


Since and ¢ are d-cohomologically independent on 8, the periods ©, and 
wz are linearly independent over R and generate a discontinuous subgroup D 


of C. Moreover, in view (26), 2 ,(s) -f "4 defines a holomorphic 


map of S onto the elliptic curve C/D. This contradicts the assumption 
that there exists on S no meromorphic function except constants. 

Consider a connected component C of the curve IC, and let N be a 
sufficiently small neighborhood of C in 8. Since w, and w, are constant on 
C, we infer from (24) that w, and w, are single-valued functions on N. 
Writing w,=,(z), W2—w,(z), we obtain therefore a holomorphic map 


h: 2—>h(2) = (w, (2), w2(z)) 


of N into the space C? of the complex variables w, and w. h maps C onto 
a point pe C? and the “jacobian” dw,(z) A dwo(z) of k does not vanish 
at each point z of N-—-@. Hence we infer by an elementary consideration 
that A(N)) contains a neighborhood of p in C? and that A+(p)==-C. Choose 
a spherical neighborhood M,C A(N) of p of sufficiently small radius e in 


COMPACT COMPLEX ANALYTIO SURFAOES, I. 765 


C? and let Ne==h*(M,.). Then h maps N.—C biholomorphically onto 
M,—}, since N,—-C forms an unramified covering manifold of the simply 
connected domain M.—p with respect to the covering map h. Hence his a 
local modification. Consequently h> is composed of quadric transformations 
and therefore one of the irreducible components of C == h> (p) is an excep- 
tional curve. This contradicts our hypothesis. Thus we conclude that 
dw, A dw, does not vanish at each point of 8. 

We fix a point o on 8, choose three closed continuous curves yı, Ya Ys 
starting and ending at o which form a Betti base of 1-cycles on S and let 


Qt), y=fg ym fo, j=1,2,3. 
Yi Yi 


Then the vectors (æ; sj), j==1,2,3, are linearly independent over R and 
generate a discontinuous subgroup D of CX R. Obviously the quotient 
space 


T=CxXR/D 
is a torus of topological dimension 3. Setting 


tu(#) = Wa(z) +) — | w: (2) |3, 
we get 
du(z) =v. 


Moreover dw, ^ dw, does not vanish at each point of 8. Hence the formula 
z>P(2) = (w.(2),u(z)) (mod D) 


defines a differentiable map P of S onto T and 8 is a differentiable fibre 
bundle over T. Moreover each fibre P(t), GET, of S is connected, since 
the projections P(y,;) of y} j= 1, 2,38, generate the fundamental group of T. 
Consequently S is a differentiable fibre bundle of circles over T. We denote 
by yo the fibre P-*(P(o)) which passes through o. 

Hach closed continuous curve yy determines an element g; of the funda- 
mental group 7(9) =#,(8,0) of 8. For the sake of simplicity we identify 
7,(S) with the covering transformation group @ in a natural manner and 
consider gj as a covering transformation of W over 8. Then, in view of (24) 
and (27), we have 


(28) j gm = W F %, 
GW = We + Fw, + By, for j= 0,1, 2, 8, 


where æ, is equal to zero. 


6 
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The projection P induces a homomorphism of (9) onto the funda- 
mental group mı(T) of T whose kernel is the cyclic subgroup of 7,(9) 
generated by go and 7,(T) is abelian. Hence we have 


9199 5G = Jo", 


where the exponent nm, is an integer. Combining this with (28) we obtain 
(29) G40, — Ip = typ Bo. 


Since the vectors («,,3;), j==1,2,3, are linearly independent over R, we 
infer from (29) that 
Nag81 + Nasa + Maass #0, 
Nası F nsr + Mats == 0. 


Hence we conclude that the periods «:, a, a; generate a discontinuous sub- 
group D of C such that C/D is compact and that z>w,(z) (mod D) defines 
a holomorphic map of S onto the elliptic curve C/D. This contradicts the 
assumption that there exists on S no non-constant meromorphic function. 


ii) Thus we see that h+? == 0 and. consequently, q = b, = 1. For our 
purpose it suffices therefore to show that p==0. The Picard variety P 
attached to S is, by definition, the subgroup of H1(S,@*) consisting of all 
complex line bundles F over 8 with c(F) <0. Since q = b, == 1, the exact 
sequence (1) is reduced to 


0>Z>C-> H8, 6*) > H2(8,Z) >. 


Hence the Picard variety P is isomorphic to the Lie group C/Z. 
Suppose that p,—1. Then, for each complex line bundle FE P, we 
obtain from (4) the inequality 


dim|F|+ dim|K—F|=—1. 


Hence we infer that either | F| or |K—F] is non-empty. On the other 
hand the non-existence of non-constant meromorphic function on S implies 
that the number of irreducible curves of 9 is finite (see Kodaira 8], 
Theorem 5.1). It follows that there exist on S at most countably many 
non-empty complete linear systems. This contradicts the above results. 


4. Multiple singular fibres of elliptic surfaces. In this section we 
shall examine the structure of neighborhoods of multiple singular fibres of 
elliptic surfaces. Ali nossible types of multiple singular fibres can be listed 
as types mlz, m=am2,3,4,° °°, b==0,1,2,--- (see Kodaira [9], Theorem 
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6.2). In what follows we write I, in place. of ‚I, and, for the sake of 
simplicity, we mean by a fibre of type I, a regular fibre. 

Let S be an anayltic fibre space of elliptic curves over a non-singular 
algebraic curve A of which the fibre Ce over a point a€ A is of type mlv 
m= 2. Let + be a local uniformization variable of the center a on A and 
let Ea denote the disk: |r| <e”, where e is a small positive number. Take 
a disk D: |o| <«, define F to be the analytic fibre space of elliptic curves 
over D induced from S | Ee by means of the holomorphic map: o—>1=—0" 
of D onto Ea, where S| E, denotes the restriction of S to Hy, and let Fe 
denote the fibre of F over o (see Kodaira [9],86). The fibre F, is regular 
for o£0 and the fibre F, is of type Im. Moreover F is a fintie unramified 
covering manifold of S| #, whose covering transformation group is a cyclic 
group $ of order m generated by an automorphism g of F such that 

GF om Foo, p = exp (2at/m). 


In case b= 0, the fibre space F has no singular fibre. Hence F can be 
represented in the form 
Fe D X C/G, 
where G is the group consisting of analytic automorphisms 
(30) © (mt) > (6, + Maler) +m), my, My €Z, 


of DXC. Note that o(o”) is a holomorphic function of r==o", |r | < e", 
with Yw(o") > 0. We denote by [e,&] the point on F corresponding to (o,f). 
The generator g of & can be written in the form 


(31) g: [o,£] > [po,€+ B(o)]; 


where (e) is a holomorphic function of o, |o| <e. Since the order of g 
is m, we have 


m-1 

È p (po) =hu(e") +1, 

y=0 
where h and } are integers. Hence we infer the existence of a holomorphic 
function y(o) such that 

y (po) —y(o) =8 (0) — (ho(o*) + 1)/m. 
We choose integers a, b, c, d and k such that 
ad—be—1, kemmh, kd—l, 


and introduce a new fibre coordinate 


E = (t—y (0) )/ (co (0) +4) 
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on DXC. Correspondingly we replace »(o”) by 
wo” (a) — (aw (o) + b)/(cw(o™) + d) 
and rewrite (80) in the form 
. (0,87) > (0, ë + to’ (o™) + ne). 
Then the formula (31) takes the form 
g: [o] > [po, t + k/m]. 


Thus, by an appropriate choice of the fibre coordinate ¿, we may assume that 
g has the form 


(82) g: [9,£] > [po, ¢ + k/m], p= exp (2nt/m), 
where the integer % is relatively prime to m. We have 
8 | Es =F]. 


We denote by ((0,£)) the point on S| Ea corresponding to [o,¢]. 
Letting @* be the group consisting of analytic automorphisms 
(r, £) > (r,+ mw(r) + na), Ny, the € Z. 
of Ea X C, we form the quotient space 
l F* = E X C/G* 


and denote by [r,£]* the point on F* corresponding to (r,£). Note that 
F* forms an analytic fibre space of elliptic curves over H, in an obvious 
manner. We denote by O* the fibre of F* over a. 

We write A =A —a, Ed = E, —a and S= 8 | A’. In view of (32), 
the formula 


(33) A: (le, t) > Lo", £— (k/2at)log o]*, 0<ljel<s 
defines a biholomorphic fibre map of S| Ed onto F*—C*. We identify each 
point ((o, ¢)) € S | E,’ C 8” with its image A((o, £)) in F* and form the union 
(84) SF a= F*U 9” 

of F* and 3’. Obviously S* is an analytic fibre space of elliptic curves over 


A of which the fibre O? over a is regular and S*—C* coincides with 8”. 


We describe a neighborhood of a singular fibre of type In, n= 1, of an 
elliptic surface in the following manner (see Kodaira [9], $8,(v)). We 
take a disk D: |a|< and write D’ == D—0. We let @ denote the infinite 
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cyclic group of analytic automorphisms of D’ x C* generated by the auto- 
morphism 
(0,1%) > (o, wo”) 
and form the quotient space 
W == D X C*/ 8 = W UC", W =D x C*/ g. 
We denote by ((o,w)) the point on W corresponding to (o, w) in D X C*. 
We take n copies W; = W7 U C;*, j= 0,1,2, >- ,n—1 of W=-WUC*, 
identify ((o, wa E€ Wa’ with ((o,wo/®));e W/ and form their union 
Ur== WU: > UW- > -UW,... 
In what follows we consider the index 7 of Wy, C,*,- - - as an element of the 
cyclic group Z,==Z/(n) of order n. Thus, for instance, ((o,%))_, will 
denote ((c,w))n1. We extend Ur to à non-compact complex analytic surface 


Fe(D) =UU p U: U yU > U daa 
by adjoining n points q, J E Z,, in such a manner that 
q= Lim((0, 0), — lim ((0, w);.- 
F*(D) forms an analytic fibre space of elliptic curves over D whose canonical 


projection is the map: ((o,w));—>o, y—>0. The fibre Fr(D) over 0 is a 
singular fibre of type I„ composed of n rational curves 


8j = C? U GU Oya, j E Zu. 


Moreover any singular fibre of type In n= 1, of an elliptic surface has a 
neighborhood which is complex analytically equivalent to Fr(D) (see Kodaira 
[9], Theorem 10.1). 

In case b = 1, we may assume therefore that F = F*(D), n==mb. The 
generator g of & can be represented in the form 


g: ((c, w)); > (po, wpt**?B(c))) sx05 > Ajko 


where @(c) is a non-vanishing holomorphic function of o, |e | <e and k is 
an integer which is relatively prime to m. We have 


B(o)B leo): >- « B(p™*e) = a hada 


Hence we infer the existence of a non-vanishing holomorphic function y(c) 
of c, Io] <e, such that 


B(o) = p’cy(c)/y(pc), ¢==exp(xt(m—1)kb/m), 
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where » is an integer. We introduce an automorphism 


8: (0,0); (le, wy(c)) a, 4 Ayers 
of F. Then we have 
sgs*: ((c, w))5 (po, wp**c)) jx. 
Therefore we may assume that g has the form . 
(85) g: (Co, w)> (lpo, wpe) jxo ` > Ajek 
Writing ((c, w,)); for ((o,w)); we consider (o, wz) as a local coordinate 

on W, Then, since w= 1,0°** for e40, we have 

do A dw;/w;= do N dWr/Wr, on WıN Wa. 


Hence we infer the existence of a non-vanishing holomorphic 2-form f defined 
on Er(D) such that 


f= do N dw;/w;, on Wy. 
We note that 


oI fo" do N dw;/w, 
represents a holomorphic 2-form defined on S| B,—=F/$. 
We form an analytic fibre space 
F* = F(B,) 


of elliptic curves over Ea and denote by C* the fibre of F* over a which is 
of type I». We have 
F*—(0* — EY X C*/ 8", 


where 6* is the infinite cyclic group of analytic automorphisms of FH,’ X C* 
generated by the automorphism: (r,w) — (r,wr?). We denote by ((r,w))* 
the point on #* —C* corresponding to (r,w). Setting 


A (o) == exp (mkb (logo — ri)? /4ri), for 0< |o] <6 
we obtain 


A (po) = CoA (0). 
Therefore, we infer from (35) that the formula 
(36) A: ((e, w))j—> ((o", wa d(o) 2, 0< | g: | <6 


defines a biholomorphic fibre map of S| Es onto F*— *. We identify 
S| Es C 8’ with F* —C* C F* by means of A and form the union 


(37) Stu. 
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S* is an analytic fibre space of elliptic curves over A of which the fibre C* 
over a is of type I, and S*—C* coincides with 8’. 
We infer from the above results that 


8 == 8 | Ea U (S*—C*), 


where S| Eg C 8 | Ee is identified with F*—C* C 8*—C* by means of 
the biholomorphic fibre map A. Thus we obtain 5 from S* by replacing 
the fibre C* of type I, by a fibre Ca of type ml». We write 


8 = La (8*) 
and call La a logarithmic transformation. 


Consider a holomorphic 2-form y defined on F*. In case b= 0, y has 
the form 


y == (7) dr A Ñ, 


where «(r) is a holomorphic function of r, |r| <. Hence we infer from 
(33) that the logarithmic transformation La transforms y into the holo- 
morphic 2-form 

(38) p = ma(o™)o™do A df 


on S| E. In case b = 1, there exists on F* a non-vanishing holomorphic 
2-form f* such that 

f* = dr A dw/w, on F*—0*, 
and 


y =a(r) f, 


where a(r) is a holomorphic function of r, |r| <e. Hence we infer from 
(36) that La transforms ẹ into the holomorphic 2-form 


(39) de ma (ao) of 


defined on 8 | By. 

We conclude that any elliptic surface is obtained from an elliptic surface 
free from multiple singular fibres by means of a finite number of logarithmic 
transformations. 

Let S be an analytic fibre space of elliptic curves over a non- 
singular algebraic curve A possessing multiple singular fibres over r points 
Oy," san" *,@ on A. Letting © denote the canonical projection of S 
onto A, we write the multiple singular fibre over a, in the ‘form m,P,, 
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P,==%1(a,), where m, indicates its multiplicity. We denote by [P,] the 
complex line bundle representing the divisor class of P,. Moreover, for any 
complex line bundle f over A, we denote by ¥*(f) the complex line bundle 
over S induced from f in an obvious manner. 


THEOREM 12. The canonical bundle K of 8 has the form 
(40) . K—= ¥*(E—f) +È (m, —1)[P,]; 


where t denotes the canonical bundle of A and f is a complex line bundle 
over A with 
(41) o(f) =—po(8) + 4(8) —1. 


Proof. Any elliptic surface free from multiple singular fibre is written 
in the form B”, „€ H1(A,Q(B*)) (see Kodaira [9], Theorem 10.1). 
Hence, by the above conclusion, S can be represented in the form 


Sm Da Das’ 5 Lasla (B"). 


B is an analytic fibre space of elliptic curves over A which possesses a global 
holomorphic section 0: u—>o(u). We identify A with the curve o(A) and 
define f to be the normal bundle of A=o(A) in B. Let {FE;} be a finite 
covering of A by small circular disks Æ; and let {fp} denote a system of 
transition functions defining the complex line bundle E—j. The canonical 
bundle of B is induced from f—f (see [9], Theorem 12.1). This means 
the existence of a collection of non-vanishing holomorphic 2-forms y; defined 
respectively on B | E, such that 


Yr = Fatt, on B |EN Es 


We obtain B” from the collection of pieces B | E; of B by identifying 4€ B | E; 
with „€ B | Ex if and only if 2; =L(nj,)2_ (see [9], Definition 9.2). The 
fibre preserving analytic automorphism L(y) of B | E; N Ers reduces to a 
translation on each regular fibre of B | E; N Hy. It follows that L(y.) keeps 
invariant any holomorphic 2-form defined on B |E; N Er. Hence, con- 
sidering each y; as a 2-form defined on B” | Ey, we obtain 


(42) Ye = frys on Bt] EN E 


This proves that the canonical bundle of B”? is also induced from the 
complex line bundle Ý — f. 

The transformation La,'.* - Leto, transforms yy into a holomorphic 2- 
forms ¢; on S| F; In case S| E, contains no multiple singular fibre, 4, 
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does not vanish at each point of S| E; In case S| E; contains a multiple 
singular fibre, say m,P,, py has the form (38) or (39). Hence the divisor 
of dy is 

, ($4) = (m, —1)P,. 


On the other hand, we infer from (42) that 
pr = finds, on 8| EN Er 


Consequently we obtain the formula (40). 

The Euler number of an elliptic surface is equal to the sum of the 
Euler numbers of its singular fibres. Therefore c,(8) is equal to ce(B), 
while c,*(S) and cı?(B) both vanish. Hence, using (3), we get 


Po(S) — g9 (8) = po(B) — 4 (B). 


On the other hand, by a result of our previous paper ([9], Theorem 12.3), 
we have 


e(f) =— p(B) +4 B)—1. 
Consequently we obtain (41). 


5. K3 surfaces. We shall say that a surface S is a deformation of a 
surface S if there exists a finite sequence of surfaces So, Sa + "0%" °°, Ss 
== § such that, for each k, Sy and Sx- belong to one and the same complex 
analytic family #, of surfaces. If S is a deformation of Se then $ and So 
belong to one and the same differentiable family of surfaces and g is differen- 
tiably homeomorphie to $, (see Kodaira and Spencer [14], I, §1). It is 
clear that any deformation of K3 surface is a K3 surface. In this section 
we shall prove the following theorem which has been conjectared earlier by 
A. Weil and independently by A. Andreotti (compare Grauert [5]). 


THEOREM 13. Every K3 surface is a deformation of a non-singular 
quartic surface in a projective 3-space. 


i) First we construct a complex analytic family of algebraic elliptic 
K3 surfaces. Let P? denote a projective plane on which a system of homo- 
geneous coordinates (z,4,2) is fixed. We take two copies W, = P? X C, and 
W, = P? X C, of the cartesian product P? X C and form their union 


W = Wo U W: 
by identifying (z,y,2,u) € Wo with (T, Y1, Z t1) € W, if and only if 


(43) ukh =]l, ues, Uy =y, 1-2 
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Similarly we define 
A= C, U-C,, 


where we identify u € C, with u, € C, if and only if un =1. Obviously W 
is an algebraic manifold and 
t: (x,y, 2,4) >u, (21,415 Zi; th) > ty 

is a holomorphic map of W onto the projective line A. Thus W is a complex 
analytic fibre bundle of projective planes over A. For the sake of simplicity 
we denote by u==œ the point u, =0 on A. 

For a point r= (To Ti’ ' ',7801,° * ",013) in the space C*# of 21 
complex variables we set ‘ 


gu) =n (u=), Alu) =I (ue), 


and we define B, to be the algebraic surface in W determined by the pair 
of equations 

fyz — 40° + g(u)a2? + h(u)2? = 0, 

| Y An’ + xg (1/0) T? + mh) = 0. 
Note that these two equations are equivalent in the intersection WaN Wi. 
We set 
(44) $e = Fr (u) =9(u)?/(g(u)?—27h(u)?*). 


Assume that r satisfies the following three conditions: 
1) 70, To ERTS 
2) if gl) =0, then o, oy for vA; 


3) the meromorphic function 9, has no multiple pole. 
Then we infer by an elementary consideration that B, is non-singular and 
that the intersection 
l C(u) = By + (uw) 


is a plane cubic curve with multiplicity 1. Thus B, ts an analytic fibre 
space of elliptic curves over A of which the canonical projection is the 
restriction ¥, of & to B,. Since the equation of the fibre C(w), ut“, is 


y?2— 42° + g(u)az? + h(u)z =0, 


the functional invariant of B, is J, (see Kodaira [9],§7). 


COMPAOT OOMPLEX ANALYTIO SURFAORS, I. 775 


In order to examine the singular fibres of B, we may assume that 


Op = Ty, for v==1,2,°°°,7, 


Ty FÉ Th for y==r 41, -,12. 


Let a'*',ap,' ` ‘,@ denote the poles of $, which are, by hypothesis, 
simple. Then we have 


(45) g(uw)* —2h(u)*— (r° — 27) TI nt (u—ap), 


where r,547 for 1Sv<aAs=r. Hence we infer that, if Us rty’ +7, 
Qy’ © *,@j;,0, then C(u) is a non-singular elliptic curve and that C (ap) 
is a rational curve with one ordinary double point. Each fibre C(r,y), 
1& v&r, is a rational curve with one cuspidal point defined by the equation: 
y°z— 4r = 0. The fibre C(oo) is a non-singular elliptic curve, since it is 
defined by the equation 


YZ — 4° + Totz + 215 = 0, To RM. 


Thus the elliptic surface B, has j singular fibres C (a),  ',C(a,) of type Iı 
and r singular fibres C(11),-°-°,C (rr) of type II. It follows from (45) 
that 

(46) ft 2r — 24, 


The equation g% == z= T, = z, =— 0 determines a projective line P in 
W and & maps P biholomorphically onto A. Thus P represents a holomorphic 
section of the complex analytic fibre bundle W over A. We identify A with 
P by means of the biholomorphie map Y. It is obvious that A==P C By. 
Hence A represents a global holomorphic section of the elliptic surface B,. 
We set 
f= yz — 4r + g (u)? + h(u)z, 
fi = yèz — 4n” + wg lu)? + tth (1/0) 
and we write fa fiey fys’ © © for Of/dx, 0f:/82,, Of/8Y,: - -, respectively. Then 
the formula 
y = du A (zdr — sdz) /fy = du, A (t,d2,— zida) fiy 
= du A (zdy — yds) /fz— du, A (yıda, — 2.dyı) [fim 
= du N (ydz—zdy) | fa = du, A (zidy, — 91441) | fro, 
defines a non-vanishing holomorphic 2-form y on B,. Hence the canonical 


bundle of B, is trivial and the geometric genus p, of B, is 1. Since the 
Euler number cz of B, is equal to the sum of the Euler numbers of the 
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singular fibres of B;, it follows from (46) that cg is equal to 24. Combining 
these results with (3) we infer that the irregularity q of B, vanishes. Thus 
we conclude that B, is a K3 surface. 

We denote by N the connected open subset of C* which consists of all 
points r satisfying the conditions 1), 2, 3) and define 8 to be the sub- 
manifold of W X N determined by the equations 


LM EE IE 

Yz da’ + wg (1/0; 7) 2? + uh (1/t, 7) 21° = 0, 
where we write g(u,r) and h(u,r) for g(u) and h(w), respectively, in order 
to make explicit that they are polynomials in u and r. Clearly 8 cuts out 
on each submanifold IV X r the surface B,X r. Thus we obtain a complex 
analytic family B consisting of algebraic elliptic K3 surfaces Br, rEN. 

ii) In this subsection we assume that S is a K3 surface. The geometric 
genus p, of 8 is equal to 1. Hence, using the formula (3) and Theorem 3, 
we get 
(47) by AMP == 0, b= 38, b — 19, by == 22, C= dd, 


Combining these results with the identities 


h” = henry, > (— { ) rishe” — Ca, 
we obtain 
(48) Abt —=20, Au, 


Let {Ti,- + +,Ty,: + +,Tss} be a Betti base of 2-cycles on 8. For any 
cohomology class c€ H?(8,Z), we denote by c(T,) the value of c on T}. 
We choose cohomology classes e; € H*(S,Z) such that 


e (Tr) = dir, for js =1,2,: E ‚22, 
and define 


22 
A(2,y) = È ancy, Opi, = 65%%, 
jik 
where the zy and the yx are indeterminates. Note that any element c of 
H?(8,Z) can be written in the form 
c = X, mje; + torsion element, m= (Ty), 
and 
(49) ®—=A(m,m). 
The natural injection: Z—> R induces a homomorphism 
i; ı: H? (8, Z) — H? (8, R). 
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We represent each cohomology class ve; by a real d-closed 2-form n} We have 


(50) (nme) == (ix 


There exists on © a non-vanishing holomorphic 2-form y. Following 
A. Weil and A. Andreotti, we associate with S the point 


(51) NAME) = (u dm); y= f y 
4 
in a projective space P** of dimension 21. We have 
y= È Am + dv, 


where v is a 1-form on 8. Hence, using (50), we obtain 


AN f yayo. 


Thus A is on the hypersurface M in P™ defined by the quadric equation 
A(z ,z)==0. This result is due to A. Weil and A. Andreotti. 


THEOREM 14. A cohomology class c€ H?(S8,Z) is the Chern class of 
a complex line bundle F over 8 if and only if the point 


m = (m, my‘ *, Maz), mi ¢(Ty), 
satisfies the linear equation l 
(52) A(A,m) =0, A=A(8). 


Proof. In view of the exact sequence 


0> (8, 0*) > H*(8,Z) —> (8,0) --, 


there exists a complex line bundle F over S with c(F) =c if and only if xe 
vanishes. Let 


7 = D My 


and let 7 denote the component of y of type (0,2). The d-closed 2-form 
ņ represents the cohomology. class uw. Hence the d-closed (0,2)-form 7® 
represents the cohomology class xc by means of the Dolbeault isomorphism. 
The é-closed (0,2)-form % is not ö-cohomologous to zero. In fact, the 
existence of a (0,1)-form o with ds =) would imply that 


J, ¥ A= Sau Ae) =o. 
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Moreover the dimension of H?(S,@) is equal to p,—=1. Consequently we 
obtain 


7? ot BY + îs, 


where ß is a constant and o denotes a (0,1)-form. Evidently xc vanishes 
if and only if 8=0. Now, using (50), we obtain 


ef. YA if, y A= f y An= Aum). 


Hence we conclude that there exists a complex line bundle F over 8 with 
c(F) =c if and only if A (à, m) vanishes, q.e. d. 

A point in a projective space is said to be rational if its homogeneous 
coordinates are rational numbers. 


THEOREM 15. If the linear equation 
(53) A(à, m) =0, A=A(S), 


has one and only one rational solution m in P* and if that solution m 
satisfies the quadric equation 
(54) A(m,m) =0, 


then 9 is an analytic fibre space of elliptic curves over a projective line A 
whose singular fibres are either of type I, or of type II. 


Proof. We choose the homogeneous coordinates m; of m such that 
Mm,‘ +, My‘ ` +, Mag ate rational integers having no common divisors and 
let 

e == >) m46;. 

In view of Theorem 14, the uniqueness of the rational solution m of (53) 
implies that the Chern class of any complex line bundle F over S has the form 
c(F) == ne + torsion element, 

where n denotes an integer. Hence we get 
(55) c(F)* = nA (m, m) = 0. 
This proves that $ is non-algebraic. 

By Theorem 14 there exists a complex line bundle # over S with 

c(H#) =e. Since the canonical bundle of S is trivial, we obtain from (4) 


_the inequality 
dim | E | + dim | —E |Z 0. 
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This implies that either | E | or |—E| is non-empty. We suppose that | E | 
is non-empty. (In case |E | is empty we replace Æ by — E.) Then, since 
c(Z) —e0, | E| contains a positive divisor D and therefore 


dim | E | =—dim|— D | —1. 


This proves the existence of non-constant meromorphic. functions on 8, while 
8 is non-algebraic. Consequently S is an elliptic surface. 

Since ht? = 0, the base curve. A of & is a projective line. In view of 
the formula (40), the triviality of the canonical bundle. of 8 implies. that 
S has no multiple singular fibres. Moreover the formula (55) shows that 
S contains no curve C with (C?)40. Hence each singular fibre of 8 is 
either of type I, or of type II (see Kodaira [9], Theorem 6.2). i 


iii) We shall examine the structure of an elliptic K3 surface 8 whose 
singular fibres are either of type I, or of type II. The base curve A is a 
projective line. We fix a non-homogeneous coordinate on A and indicate a 
point on A by its non-homogeneous coordinate u. We denote by } = § (u) 
the functional invariant of S and by. G the homological invariant of S (see 
[9],87). Then we have 


S — Bt, ne H (A, Q (B.*)), 


where B is the basic member of the family F (9, @) (see [9], Theorem 11.1 
and §8). For the sake of simplicity we assume that }(0)40,1,0. Let 
C(w). denote the fibre of $ over u. There are certain relations between the 
structure of C (u) and the behavior of 9 at u (see [9], §8 and Table I in § 9). 
We infer from these relations that the meromorphic function $ has no 
multiple pole, that C(u) is a singular fibre of type J, if and only if u is a 
simple pole of $ and that C(u) is a singular fibre of type II if and only 
if u is a root of } of multiplicity =1 mod(3). If u is a root of $ and if 
C(u) is a regular fibre, then its multiplicity is divisible by 3. The multi- 
plicity of each root of $—1 is even. Moreover, letting j and r denote 
respectively the numbers of the singular fibres of S of type Iı and of type II, 
we have 
jt er = cz = 24, 
Thus we infer that 


(58) 9/($—1) =a (wn) TL um TL, (won) 


where a0, 7,Aog, and „Ar forlSv<pXr. We denote the (simple) 
poles of 9 by a,a,,°--,a; and let Ar, for ve1,2,---,7r. We 


780 K. KODAIRA. 


conclude that g has singular fibres C(a,),---,C(a;) of type I; and 
C (aja), © *, C (Gyr) of type I. 


LEMMA 2. The homological invariant G of S is uniquely determined 
by $. 

Proof. We denote by (w(u),1), So(u) > 0, the periods of the elliptic 
curve C(u), uz£a,. w(u) is a multi-valued holomorphie function on the 
punctured sphere A’ == A—{ap} and § (u) —J(w(u)), where J denotes the 
elliptic modular function (see [9], §7). We fix a point b on A’ and represent 
each element of the fundamental group 7,(A’) by a closed continuous curve 
8 on A’ starting and ending at 6. The analytic continuation along 8 induces 
a modular transformation 


w(u) > B(B)o(u) = (ago (u) + bg)/ (cgo (u) + dp), 


where ag, bg, cg, dg are rational integers and agdg— bgcg = 1. The homo- 
logical invariant G is determined by a representation of mı(A’) of the form 


fe d 
(57) (R): p> (R)(p)—(% 7) 
(see [9], §7). To prove the uniqueness of G it suffices to show the unique- 
ness of the representation (R). 
For each point a, we choose a closed continuous curve a, on A’ starting 
and ending at b which is homotopic on A’ to a positively oriented small circle 
around dp. Obviously the closed curves %,°--,@p,°* *,@, generate the 
fundamental group mı(A’). For each generator a, the matrix (R)(a,) is 
equivalent to (5 5 
fibre C (ap) is of type I, or of type II (see [9], 89, Table I), while (R) (ap) 
is determined by (57) uniquely up to a factor +1. Hence (R)(a,) is 
uniquely determined. It follows that the representation (R) is unique, q. e. d. 
Let 


) or a g ) according as the corresponding singular 


... Bu 
rT= (To Ti: "0,78, 71," ° "3 Try Orsi, s012) To = 27a. 


Then, comparing (56) with (44), we infer that the functional invariant $, 
of the elliptic surface B, coincides with $. Hence, by the above Lemma 2, 
the homological invariant of B, coincides with G. Moreover B, possesses a 
global holomorphic section over A. Consequently B, coincides with the basic 
member B of the family #(},@) (see [9], Theorem 10.2). 


LEMMA 3. The cohomology group H*(A,G@) vanishes. 
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Proof. In order to make explicit that @ is the homological invariant 
of Br, we write G, for G. We have 


H?(A, Gr) =2°/M,, 
where M, is; the submodule of Z?==Z@ Z generated by: the: elements 
(m, n) (R) (8) em (m, ny, (m, n) € 2,8 € m,(A’). 


We infer readily ihat M, depends only on the number r of singular fibres 
of type II of B,. Moreover M, is lower semi-continuous in r in the sense 
that, for each point r € N, there exists a positive number e such that M, CM, 
for |£—r|<e To prove the vanishing of Z?/M,, it suffices. therefore to 
consider. the case in which r=1. Now, if r= 1, then, assuming the normal 


form > a o) for (2) E we obtain 
(m,n) (B) (aj) — (m, n) = (—n, m— n). 
This proves that Af, = Z7, q.e. d. 


We employ the notation of our previous paper [9]. By the above 
Lemma 3, the exact sequence (11.7) in [9] is reduced to 
h* 
f -=> H*(A,O(f)).—> E (A, Q (B,*)) > 0. 
Hence we infer that S=B"®, se H1(A,Q(f)) (see [9], Theorem 11.1). 
Thus we obtain the following 


THEOREM 16. Any elliptic K3 surface whose singular fibres are of 
type I, or of type II can be represented in the form 


S= BMC), se H(A, O(f)), BE B. 


We note that the collection of the elliptic surfaces BY, se H*(A, af) J 
forms a complex analytic family (see [9], Theorem 11.3). The elliptic K3 
surface S is therefore a deformation of BE B. 


iv) We consider an arbitrary K3 surface S and write the non-vanishing 
holomorphic 2-form y on S explicitly in the form 


A 
y= 3,2 panda N dag, Ypa = — Yap. 

The mapping 

(58) ae N 08/02 ¥ bapagdzg 

induces an isomorphism i = 

(59) Lo Oe 0}, 
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Combining this with, (48); we obtain ge. VET a l Na 
(60) dim H+ (8,8) =20, °° ~° ~dim#H?(8,@) 0. 
We denote by t= (t, ta > *, t2) a point in C and by Us a spherical 
domain: consisting of all points t, |t|:< 8, where 8 is a positive number. 
In view of (60) we infer from a theorem of Kodaira, Nirenberg and Spencer 


[13] the existence of a complex analytic family F. of surfaces | Bo, tE Us, 
such that Se= 8S and such that the map 


maps the tangent space T,(U») nee: onto 7'1(8,®), N that 
d-is sufficiently small, where the symbol 88,/8t denotes the infinitesimal 
deformaiton of S: along 4/ét. Let @; denote the sheaf over 9; of germs of 
holomorphic vector fields. Since each surface 8, is a K3 surface, the dimen- 
sion of H*(S;,@,) is independent of t. Hence we infer from a stability 
theorem (see Kodaira and Spencer [14], III, §1). that p: 0/8t— 88,/dt 
maps T;(Us) isomorphically onto H*(S;,®;). Combining this with a 
theorem of completeness (Kodaira and Spencer [15]) we conclude that the 
family F is effectively parametrized and complete. 

We may assume that the surface S, tE Us, have one and the same 
underlying differentiable manifold X.. We identify X with 8 and employ 
local complex -coordinates (2:,%,) as local differentiable coordinates on X. 
Moreover we choose local complex coordinates (w,,%,) on the surface 8, 
such that w,—,(z,t) and w= w,(z,¢) are differentiable functions of z, 
and za which depend holomorphically on ¢ and satisfy the boundary conditions 
w1(z,0) == Z, wa(2,0) =z, (see Kodaira, Nirenberg and Spencer [13]). 
There exists on each surface 9; a non-vanishing holomorphic 2-form y(t). 
We may assume that y(t) depends holomorphically on t. This means that, 
when y(t) is written in the form 


(61) PE) =E È ven, f) dwale, t) A dup, t); 


the coefficients yag (w, t) are holomorphic functions in w,, ws and t. Supposing 
that the 2-cycles Tj, j= 1,2, - -,22, are fixed on X, we set 


NORTON 


The periods A,;(2) are holomorphic functions of t and the quadrie 
equation 


A(A(t),A(t)) = E agy (E) A(t) = 0. 
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ENGEN» = (Aut), i *,Ay(t),° rei ‚Az(t))- 


is a ai map of Us into M. The following theorem. is ne to A. 
Weil and A. Andreotti. 


THEOREM 17. The map: t— A(t) maps Us biholomorphically onto an 
open subset of M, provided that § is suficientiy small. 


Proof. “We take a tangent vector 8/dt € T,{Us) and, for any holomorphic 
function f(t) of ¢, we write — 


a f (0) == (8f (E) /8t) io: = 
For our purpose it suffices to show that the simultaneous Smahiche- 
(62) © A4y(0)A’x(0) —Ar(0)°;(0) = 0, f=, 2+ + +, 82, 
hold only if 9/85 vanishes, Assume that (62) hold. Then we have 
| N4(0) = adj(0), j=l, Be 22, 


where a is a constant. Hence we get 


(682) y (0) —ay (0) = de, 
where v is a 1-form on 8. From (61). we obtain 
(64) y/(0) — Siyap(z, 0)ĝw'a(2,0) A dze + (2, 0)-form. 


We write v as a sum 
v = yO) + py) 


of a (0,1)-form v® and a (1,0)-form », We then infer from (63) and 
(64) that ` 
dv) — 0. 
Since H1(S8, ©) vanishes, this implies that 
| wO — ip, 


where » is a differentiable function on 8. Substituting du for o in n (68) 
we get 
Y (0) — ap (0) El — ap) + do, 


Comparing this with (64) we obtain 
(65) E yop (2, 0)w'a (2,0) A ddl — ôa). 
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The mapping (58) induces an isomorphism of the §-cohomology group 
of vector (0,1)-forms onto the 4-cohomology group of: (1, 1)-forms. The 
infinitesimal deformation p.(6/ét) is represented by the a class © 
óf the Ö-closed' vector (0, 1)-form 


> Bu a (2; 0) 8/82 


(see Kodaira, Nirenberg and Spencer [13]). The mapping ey maps: this 
vector (0, 1')-form: onto the- ö:closed (1, 1)-form 


Dyas (2, 0)6/a(2,0) A deg. 


Hence it follows from (65) that pọ(3/3t) vanishes. This proves the ae 
of /dt, d. e.d. 

Now we shall prove that, for any positive number e <S &;: at iait one: of 
the deformations §;, |t| <e of 8 is an elliptic K3 surface whose singular 
fibres are of type I, or of type II. For this purpose it suffices to show the 
existence. of a point t€ U, such that A(t) satisfies the hypotheses of Theorem 
15. Let Q denote the field of rational numbers. cae 


Lemma 4. If a point we M is rational over Q(t), as then 
there exists a rational point m E€ P% satisfying the equations ` 


(66) A (i,m) = A (t, m) =0. 


Proof. It suffices to consider the case where a is not rational. Con- 
sidering » as a vector in C*, we write p =r -+ is, where r and s-are rational 
vectors which are not zero. Since A(s,») vanishes, we have 


Zur A(r,r) = A(s,8). 


IE A(r,r) = A(s,s) = 0, then, setting mr, we obtain (66). 
If A(r,r) = A(s,8) 3£0, then we can choose rational vectors ry j= 1, 
+ -,20, such that 


A (1,15) = A(8,1;) == 0, A(7y,15) £0, A(re, ty) =0 for kj. 
Since 6*==3 and b’=19, the signature of the quadric form 


20 
2A (ry, 75) 27 
j=l 
is either (3,16) or (1,19). Hence the quadric equation 


20 
DAt ym = 0 
FF 


COMPACT COMPLEX ANALYTIO SURFAOES, I. 785 


‘admits non-trivial rational solutions m,’ > -,my,° ` °, Mso (see Skolem [17], 
Kap. ILI; $1), ‘Consequently, setting m — > mjr}, we.obtain a rational vector 
m+ 0: which satisfies the equations (66), q.e. d. 

For each rational point n in P** we define &, to be the subvariety of M 
determined by the equations 


A(z,n)—=4(z,r) =0. 


M contains an everywhere dense subset of points which are rational over 
Q(i) (see Skolem [17], Kap. III, §1). Hence the open subset A(U.) of 
M contains a point p which is rational over Q(i). With the aid of the 
above Lemma 4 we find a rational point m in M such that ze. Then 
A(O.) Na is a non-empty open subset of Zm, while Em N Ea is a proper 
subvariety of Zm for any rational point n £m in P**. . Consequently we can 
find a point A(t) € A(Ue) NEm such that A(t) £ =, for all rational points 
n&m. It is clear that this point A(t) satisfies the hypotheses of Theorem 15. 

Thus we see that there exists a point t.¢.U,.:such that S; is an elliptic 
K3 surface whose singular fibres are of type I, or of type II. Applying 
Theorem 16 to this surface S;, we obtain the following 


Turormm 18. For any K8 surface S, there exists an arbitrarily small 
deformation 8, of 8 which:is an elliptic K3 surface of :the form 


Bro, se H1(A,0(f)),Be B. 


.. This theorem shows that. every K3-surface is a. deformation of a member 
of the complex analytic family 8. Any non-singular quartic surface in a 
projective 3-space is a deformation of a member of 8, since it is a K3 surface. 
Consequently every K3 surface is a deformation of a non-singular quartic 
surface in a projective 3-space. This completes the proof of Theorem 13. - 


6. Surfaces with trivial canonical bundles. Let $ be a surface with 
a trivial’ canonical bundle. Since the first Chern class c of & vanishes, it 
follows from a result of Atiyah and Hirzebruch [1] that the Todd genus 
of § is even, while the gemetric genus pp of S is equal to 1. Hence, by 
(3), the irregularity q of S is even. Moreover the triviality of the canonical 
bundle implies that S contains no exceptional curve. 

A) In case 6, is even, it follows from (13) that 


8g + b- = 19. 
Hence g is equal to either 0 or 2. 
If g= 0, then S is a K3 surface. 
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If q= 2, then.there exist on 8 two linearly independent d-closed holo- 
morphic 1-forms ¢; and $, and there is defined a holomorphic map 


bi 29 (2)—=( ("bu f2) (oa 9) “ 


of § into the Albanese variety @ attached to S (see (15)). 

To verify that &ı A $2 does not vanish, we suppose that ¢, A da vanishes 
identically. . Then the image ®(8) is an irreducible curve in @.. Hence 
we infer that there exists a holomorphic map © of § onto a non-singular 
algebraic curve A of genus 2 such that the inverse image Cy — (u) of any 
general point 4u € A is an irreducible non-singular curve. Since the canonical 
bundle K of 8 is trivial, we have “ 


27 (Cu) — 2 = (Cy?) + (KO) = 0. 
Thus 8 is an elliptic surface and therefore, by (40), 


v*(E—f) + X (m,—1)[P,] = KE =0. 
It follows that . 
_e(f) = c(E) == 2. 


This contradicts the formula (41). 

In view of the triviality of the canonical bundle of S, the holomorphic 
2-form ¢: A ¢2 does not vanish at each point of S. Hence & is a locally 
biholomorphie map of S onto @ and therefore 8 is an unramified SITE 
surface of @. Consequently $ is a complex torus. 


B) In case b, is odd, it follows from (13) that 
8q + b- =a 18, 
while, by Theorem 8, 2q'=b, +1. Hence g is 2 and b, is 3. In view of 
Theorems 4 and 11, S is therefore an elliptic surface. Let A be the base 
curve of § and let & denote the canonical projection of 9 onto A. By (0) 


we have 
¥* (E—Ff) + E(m,—1)[P,] =K =0. 


Hence we infer that S has no multiple singular fibre and that ff. Since 
S can not be deformed into an algebraic surface, 9 is a complex analytic 
fibre bundle of elliptic curves over A whose structure group is the group of 
translations (see [9], §11). Using (41) we get 

c(t) =¢(f) =— p +q—1—0. 


Hence the base curve A is elliptic. 
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‘We fix a point o on S, denote by C the fibre of 8 passing through o 
and choose circles yı and’ y, on C which pass through o and form a base of 
1-cycles on O. Moreover we choose closed continuous curves ys and y, on S 
starting and ending at o such that &(y,) and &(y,) form a base of 1-cycles 
on A and. define gı; 92, gs, gs to be the elements of the fundamental group 
mı( S) =m (8,0) determined respectively by yi, ys, ys, ys. Clearly the pro- 
jection & induces a homomorphism of (S) onto the fundamental group 
mı(A) of A whose kernel « is the subgroup of +,(8) generated by g, and gz. 
It follows that r,(8) is generated by 91, 92, 9s, 9s. The commutator gsg.gs ‘gs? 
belongs to x. Hence, by an appropriate choice of y, and ys, we obtain 


(67) © JaJa == 929492, 
where m is an integer. 

- Let # denote the holomorphic 1-form on $ induced from ’a non-vanishing 
holomorphic 1-form on A. We infer in the same manner as in Section 3, 


Bi) the existence of’a real d-closed 1-form e on S such that ¢, ¢ and o 
generate the d-cohomology group of 1-forms on 8 and stich that 


doo = ġ Ab. 


where oo denotes the component of o of type (1,0). Moreover there exists 
on. the universal covering W of S a pair of holomorphic functions Wi, Ws 
satisfying the differential equations. 


f dw: = $, 
. f l dw: = o + thid. 

We identify 7,(S) with the covering transformation group'G of W over 8 
in a natural manner. For any covering transformation ge G we have 

f Gy == W: -+ a, 

| gwa = w + aw, +8 
(see (34)). This formula defines a representation R:.g>R(g) of G by 
affine transformations of the space C? of the complex variables w, and wz. 
Letting 

. : Gly — Wr +9, ga = We + w: + Bi for j= 1,2,3,4, 
and: using (67) we obtain : 
Q, = Q = 0, Aah, — Xag =m MBa. 


It follows that mf.540, since the periods a3, a, of the elliptic curve A are 
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linearly independent over R. Hence the restriction to C of dw, is a. non- 
vanishing holomorphic 1-form and its periods £., £: are linearly independent 
over R. Consequently the representation R: G+ R(G) is an isomorphism. 
R(@) is a properly discontinuous group of affine transformations without 
fixed point of C? and the quotient space C*/R(G) is a (compact complex 
analytic) surface.. dw, A dw, is a holomorphic 2-form on $ which does not 
vanish identically, while the canonical bundle of 8 is trivial. Hence dw, A dw, 
„does not vanish at each point of 8. Therefore the pair of holomorphic func- 
tions w, and ws defines a locally biholomorphic map p of W into C’. . The 
map » induces a locally biholomorphic map of. S == W/G into €*/R&(G) 
which is surjective in view of the compactness of 8. Hence a is surjective. 
and biholomorphic. Consequently $ is complex analytically ne 
to C*/R(G). Thus we obtain the following 


THEOREM 19. Let S be a surface. If the canonical. bundle of 8 is 
trivial, then S is'a K3 surface, a complex torus or an elliptic surface of the 
form C*/G, where C? is the space of two complex variables (7,23) and G is 
a properly discontinuous group of affine transformations without fixed points 
of C? which leave invariant the 2-form dz, A da. The first homology group 
of the elliptic surface C?/G is 


| E . H (C/G, Z) =Z O Z © Z D Zm, 
ie Zm denotes a cyclic group of a finite order m. 


THEOoREM 20. Assume that the first Betti number b, of 8 is even and 
the geometric genus p, of S is positive. If the first Chern class ca of 8 
vanishes, then I 18 either a K3 surface or a complex torus. : 


Proof. In case 8 has no meromorphic function except constants, 8 is, 
by Theorem 11, either a K3 surface or a complex torus, since the vanishing 
of c, implies that § contains no exceptional curve. We may assume therefore 
that 9 is either algebraic or elliptic. Since p, is positive, 9 has an effective 
canonical divisor. K. In view of the above Theorem 19,-it suffices for our 

‘purpose to prove that Æ is zero, Since c, vanishes, K is homologous -to-zero. 
To prove that K is zero, it suffices therefore to show that every positive 
divisor on 8 is not homologous to zero. This is obvious if S is algebraic. 
Hence it suffices to consider the case in which 9 is a non-algebraic elliptic 
‚surface. 

Let A denote the base curve of the elliptic surface 8 and let {Ej} be a 
finite covering of A by small disks H; Since b, is even, there exists a 
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complex: analytic family of analytic fibre spaces S, tEC, of elliptic curves 
over A which has the following three. propecia: ' 


iy So coincides with 8; 

i) S, is algebraic; 

iii) the complex structure of each piece 8. | E; is independent of ¢ 
(see [9], §14). 
í Consider a positive divisor D == Sul. My > 0, composed of irre- 
dueible curves C, on 8. Each irreducible curve C, is a component of a fibre 
of § (see [8]; Theorem 4.3). Hence C, is contained-in a piece $ | E}, while 
Sı | E; is independent of ¢. Therefore D= $ m,C, represents a positive 
divisor on each surface S; In particular D is a positive divisor on the 
algebraic surface $,. Consequently D is not homologous to zero. 


qe Classification of surfaces. We shall ‘say that " surface S, is bi- 
rationally equivalent to § if there exist quadric transformations Qin Qiy °°; 
l Qir, Qi Os; D Qe such that 


- Qir’ © + QiaQu (81) — Qa’ © QQ (8). 


By the birational class of 8 we shall mean the class consisting of all surfaces 
which are birationally equivalent to 8. We shall say that S, dominates 8 
and write 8, >9 if 


z Ki = Qs 5 "Q-Q: (8). 


Clearly the birational class of S forms a partially ordered set with respect 
to the domination >. We call $ a relatively minimal surface if S dominates 
no surface other than 8. It is obvious that S is relatively minimal if and 
only if $-contains no exceptional curve (of the first kind). We call S a 
minimal surface if every surface belonging to the birational class of 8 
diminates 8. For each positive integer m we define the m-genus Pm = P,y,(8) 
of 8 to be the dimension of the pluricanonical system | mK | increased by 1, 
where K ‘denotes the canonical bundle of 8. Note that P, coincides with 
the geometric genus py. In case a plurigenus Pw of 8 is positive, every excep- 
- tional curve on § is a fixed component of the pluricanonical system | mK |. 
‘Hence we infer that, if S contains no exceptional curve and if a plurigenus 
Pm of 8 is positive, then S is a minimal surface. 


- THEOREM 21. Surfaces free from exceptional curves can be classified 
into the, following seven classes (see Table I): _ 


790 E K. KODAIRA. 


Io) the class of relatively minimal algebraic surfaces with pg==0 3. 
Il.) the class of K3 surfaces; N i 
III.) the class of complex tori (of complex dimension 2) ; 
IV.) the class of minimal elliptic surfaces with bb=0(?), p 1, 
Gl, 10; 
Vo) the class of minimal algebraic surfaces with p Z= 1, c? > 0; 
VI.) the class of minimal elliptic surfaces with b,=51(2), p Zi, 
G’ == 0; 
VII) the class of minimal surfaces with b, == q =1, py= 0. 





TABLE I, ° 
class ba Ps > G? structure’ 
Io even 0 algebraic | 
TI, 0 + = 0 0 K3 surfaces 
Il, 4 + = 0 0 complex tori 
IV, even + 0 0 elliptic 
Vo even + + algebraic 
VI, odd + 0 ‘elliptic. 
VI, 1 0 ? 


. To prove this theorem we assume J to be a surface free from exceptional 
curve and denote by py, Pm, 9 bu Cu, > > the geometric genus, the m-genus, 
the irregularity, the first Betti number, the first Chern class, - - - of $. More- 
over we denote by K either the canonical bundle of S or a canonical divisor 
on 8. We remark that, if an irreducible curve C on S has (C°) <0, then 
(KC) is non-negative. In fact, since 


(KC) + (0°) =% (0) —2, 
if (KC) and (0?) were both negative, then C would be an exceptional curve. 
Leama 5. If py is positive, then c,? is non-negative. 


Proof. Since, by hypothesis, p, is positive, there éxists on S an effective 
canonical divisor K. Assuming that K-40, we let K=—D4,C,,.k,=21, 
where the C, are irreducible curves. We have 


(EC) E07) +F ky(CyC,) = ky (C,?). ° 
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Combining: this with the above remark we infer that (KC;,) is. na 
and, consequently, cı? = $, k, (KC,) is non-negative. 


Lemma 6. Assume that c2<=0. Let D= J, k,0, be a positive divisor, 
where the O, denote irreducible curves on S and the coeficients k, are 
positive integers. If D belongs to a pluricanonical system | mK |, then each 
irreducible component C, satisfies 


(68) (K0,) =0, 2x (Cy) —3 om (0) =0. 
Proof. We have 
. m(KC,) =k, (C) + ‚a ta (CC) Z= k,(0,°). 


Combining this with the above remark we infer that (KC,) is non-negative, 
while 
dk, (KC,) = me? = 0. 


Hence (KC,) vanishes and therefore (C,?) is non-positive. 


Lemma Y. If c27—0 and tf P, 22 for a positive a ad m, then 8 
is an elliptic surface. 


Proof. By hypothesis the dimension of the pluri-canonical system | mK | 
is positive. Let A denote the fixed component of | mK |. Then any general 
member of |mK| has the form A +20, where the C, are irreducible 


curves. Note that 2 C, is a member of the complete linear system | mK — A | 


of dimension = 1. Sure a general member $, O'm (pA ons of g mK — A I 
n 


By (68), we have 
2 (C'x0r) +(40,) =m(KC,) =0 


and, consequently, 
(69) (0,0,) = (40,) =0. 


This shows that the curve 3,0’, does not meet $, C,. Thus any two general 
members of | mÆ -—A | do not intersect. Consequently the complete linear 
system | mK — A | is composed of a pencil of curves in the following manner: 
There is a holomorphic map % of S onto a non-singular algebraic curve A 
such that the inverse image 4 (u) of any general point u € A is an irreducible 
non-singular curve and | mK — A | is induced from a complete linear system 
|d| on A by means of w. Thus, if Yu, is a general member of |b|, then 
” 
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XC, -C,—"(u,), is a general member of |mK —A |. Since .C, does not 
niet Cy, Az£v, we obtain, using (68) and (69), -the equality - - 

27 (Cy) — 2 = (0) = m(K0,) — (40,) =0. 
This proves that C,—="(u,) is an elliptic curve. Thus we infer that 8 


is an elliptic surface, q. e. d. 
We shall examine various cases separately. 


1) If 6,==0(2) and Py 0, then, by Theorem 10, 9 is an ebai 
surface. 


2) If b,==0(2), p> 0 and c =-0, then, by Theorem 20, en either 
a K3 surface or a complex torus. 


3) If nS? and c° = 0, then, by Lemma 7, 8 is an elliptic surface: 


4) If b,==0(2), p= 1, c? = 0 and c, 40, then by (13), 8g +19, 
and therefore g is not greater than 2. Moreover there exists on S a positive 
canonical divisor K == Sik,C,, k,Z:1, where the C, are irreducible curves. 


a) If q=0, then, using (4), we get ao 
P, = dim | 2K | + 1 Z — dim |—K | +1 — 2. 


Hence, by Lemma 7, Sis an elliptic surface. 


8) I£ q=1, then the Albanese variety @ attached to § is an elliptic. 
curve and there is a holomorphic map ® of § onto Q. ‘Take a general point 
u of @ and let Tu= (u). We infer readily that T, is a non-singular 
irreducible curve. ah: 

If (KT,) vanishes, then 2r (Lu) —2 = (Ty?) =.0 and, N, g 
is an elliptic surface. 

If (KT,) does not vanish, then one of the irreducible components, say 
C=C, of K meets Ty. Hence @ maps O onto @ and therefore the genus 
of C is not smaller than 1, while, by (68), the virtual genus (C) is not 
greater than 1. Consequently C is a non-singular elliptic curve and 


(70) (KC) = (©) 0. 


ee 


For any complex line bundle F over S we denote by Fo the restriction of F 
to the curve ©. It follows from (70) that C does not meet the curves Or 
v=2%. Hence we obtain 


[£]o—k[C]o, k == ky, 
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while the canonical bundle [K +C ]o of C is trivial. Setting m—2k-+ 2, 
we infer therefore that [mK]o is trivial. Hence we have the exact sequence 


0 H°%8, 6(mK —C)) > HS, 6(mK)) > C> H+(8, 6(mK —C))->---, 
while, by the Riemann-Roch-Hirzebruch theorem, 
dim H°(8, 6 (mK — C) ) — dim H! (8, 6 (mK —C)) —1. 


Hence we obtain 
Py, = dim H°(S, 6(mK)) 22. 


Consequently, by Lemma 7, S is an elliptic surface. 


y) if qg==2, then the Albanese variety @ attached to S is a complex 
torus of complex dimension 2 and there exist two linearly independent holo- 
morphic 1-forms ¢:, pa which determine a holomorphic map & of 8 into @ 
(see (15)). 

If ¢: A $z does not vanish identically, then K coincides with the 
divisor of dı A da: 

(di A 2) =K = $ k0, 


Tf the image $(C,) of each curve C, is a point, then we infer in the same 
manner as im the proof of Theorem 5.8 in our previous paper [8] that © 
maps S ‘biholomorphically onto @. This contradicts the assumption that 
67€0. Thus we see that at least one of the images, say ®(C,) is a curve 
in @. Since, by (68), the virtual genus +(C,) is not greater than 1, Cy 
and ®(C,) are both non-singular elliptic curves. There exists therefore a 
holomorphic map of @ onto a non-singular elliptic curve which maps ®(C,) 
onto a point. Hence we infer the existence of a holomorphic map © of S 
onto a non-singular elliptic curve A such that (C,) is a point and such 
that the inverse image &"(u) of any general point u€ A is a non-singular 
irreducible curve. 

Let a==(C,). Since, by (68), (KC,) = (C,?) =0, the curve O, does 
not meet C» v2:2. Moreover the inverse image &*(a) of a coincides with. 
Cı. To prove this we choose ¢, and œ, such that ds is (induced from) a 
holomorphic 1-form on A and let r denote a local uniformization variable on 
A such that dr = p». Let ¢ be an arbitrary point on C;. Since the restriction 
of ¢, to C, is a non-vanishing holomorphic 1-form, we find a local coordinate 
(21,2) of the center ¢ on 8 such that dz, == œ, and z vanishes on C,. Ina 
neighborhood of £, we have 


(di A $2) =k., k = k. 
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This means that 
dz, Ndr (Y(t, 22) ) = as*f da, N daa; 


where f is a non-vanishing holomorphic function on a neighborhood of £. 
It follows that 
T(E (41, Z2) ) == 29***g + constant, 


where g is a non-vanishing holomorphic function on a neighborhood | of &. 
Therefore, in a neighborhood of £, the curve &*(a) coincides with C,. This 
proves that C, is a connected component of ¥*(a), while, since ¥*(u) 
is irreducible for any general point u, ¥*(a) is connected. Hence W!(a) 
coincides with (Cj. . 

Since Cy == Y (a) does not meet C,, v Z2, the curve C= Y> (u) does 
not meet C, for any general point u€ A and therefore 


2r (Cu) —2 = (KO,) + (0?) = 0. 


Consequently § is an elliptic surface. 

If ¢: A ġa vanishes identically, then (S) is a curve in @. Hence 
we infer that there exists a holomorphic map & of 8 onto a non-singular 
algebraic curve of genus 2 such that the inverse image Ou == Y> (u) of any 
general point u€ A is a non-singular irreducible curve. Y maps each curve 
C, onto a point on A, since, by (68), the genus of C, is not greater than 1. 
Hence Cu does not meet C, and therefore . , 


dr (Cy) —2 == (KC,) + (Cy?) = 0. 
Consequently § is an elliptic surface. 
5) If c?>0, then, by Theorem 9, S is an algebraic surface. 


6) If b,==1(2) and p,>0, then, by Theorems 4 and 11, 8 is an 
elliptic surface. 


7) If b,==1(2) and p,=0, then S is either an elliptic surface or a 
surface with no meromorphic function (except constants). In case 9 is 
elliptic, S has no singular fibre other than that of type mIo, since b, is odd 
(see [9], 811 and §14). Hence 


12(pp—q+1) == 0 


and consequently, g=b,—1. In case S has no meromorphic function, we 
infer from Theorem 11 that q =b, =1. We infer readily that S is minimal. 
This completes the proof of Theorem 21. 
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- We shall examine the asymptotic behavior of the plurigenera of surfaces 
with positive geometric genera. We shall indicate by writing P,—~f(m) 
that : 3 ; 

lim Px/f(m) =i. 


Assume 8 to be a minimal surface with a positive geometric genus of which 
the canonical bundle is non-trivial. By the above Theorem 21, § is either 
an elliptic surface or an algebraic surface with c,* > 0. 

-In.case 8 is an elliptic surface, the canonical bundle K of Sis given 
by the formula (40), namely, 


Sa Kum ¥*(E—f) E (m1) P]. 


ERN by ‘hypothesi, dim E the complete: linear system 
| £—f| on the base curve A of $ contains an effective divisor d. Let d denote 
the degree of 6. For an arbitrary positive integer m, we determine non- 
negative integers n, and r, such that 


m(m,—1) = mm, +t © n&m], 
and define i 


bin = mÒ H D fra, dye (Py). 
This divisor Òm determines a complex line bundle. [ġa] over A and - 


mK =¥* ([dn]) + Er [P]. 
‘Hence we obtain ; ’ 
C P„—dim | dx | +1. 
Let 
rn (1—1/m,). 


Since, by hypothesis, K is non-trivial, x is positive. Therefore, denoting by 
dy the degree of ba, we get 
. dy, == md +. Din,—xm. 
. : . ‚ . 
Consequently we obtain 
(71) Pym Km, «>0. 


In case § is an algebraic surface with c,*> 0, a theorem of Mumford 
[16] asserts that the superabundance dim H*(S,@(mK)) vanishes for all 
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sufficiently large values of m.  Hence, using the. Riemann-Roch-Hirzebruch 
theorem, we obtain 


(72) ` Py ġm(m—1)a? + po— gti 


for all sufficiently large values of m and 
(73) Pamxm?, «—=}0°>0. 


We define classes I,II,- - -,VII to be respectively the classes of those 
surfaces which are birationally equivalent to surfaces belonging to the classes 
I,, IIo, + +, VII. Since the numerical characters b, and P„ are invariant 
under quadric transformations, we infer from the above results the following 


THEOREM 22. Surfaces. can be classified into seven classes I, II,” --, VII. 
The surfaces of the classes I,II,- - -, VII are characterized respectively by the 
following conditions: 
(I) b,==0(2) and 0; 
(IT) }b,=0, 9-1 and Py~1; 
(II) bi=4, p,—=1 and Pa—1; 
(IV) b,=0(2), py >0 and Pu —xm, >Ù; 
(Y) 0,=30(2), pp >0 and Pa—ım, x>0; 
(VI) 6,=51(2) and p,>0; 
(VII) by—=1 and py=0. 


THEOREM 23. Any deformation of a minimal surface with a. positive 
geometric genus is minimal. 


Proof. Since exceptional curves on surfaces are stable submanifolds 
(see Kodaira [12], Theorem 5), it suffices to show that any sufficiently small 
deformation of a minimal surface with a positive geometric genus is minimal. 
Consider a complex analytic family of surfaces Ss |t] <1, where ¢ denotes 
several complex variables (4,2: * +,t), and assume that 9, is a. minimal 
surface with p,(So) >0. Note that the numerical characters. p == pp (S+), 
q= q(8:) and c? = ¢,2(S;) are independent of t. Each surface 8, is obtained 
from a minimal surface 8;* by means of a. finite number of quadric trans- 
formations. Denoting by n: the number of quadric transformations Bu 
to transform 8,* into Sa we have 


a) =m + a. 
Sines, by the Riemann-Roch inequality: (4), l 
Pa(8:*) >imm— 1) (Er) Hp— gtl for m23, 
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we get u az e 
Pa) >imm—1) (mte) F pgti for m=, | 
while Pm(S:) is an upper semi-continuous function of t. Hence, for each 
integer m = 2, we find a positive number em such that 


Palo) 2 $m(m—1) (m+ at) +9 —g9+1, for |t| <en. 
On the other hand, we infer from (71) and (72) that 
Pn(8) S3m(m— 1)? + km, 
where k'is a positive constant. Hence we obtain- E 
l l dm (m —1)m + po— qS km, l “for |t| < em 
This proves that n; vanishes for |¢| < en, provided that m is sufficiently 


large. Consequently the surface S; is minimal if |t| is sufficiently small, 
q.e. d. 


THEOREM 24. The classes II,,III,,- - -, VI, of surfaces are closed under 
deformations. The classes I,II,- - -,VII of surfaces are closed under 
deformations. - en 


Proof. The classes I, VI, VI, IIo, IIo: © ',VI, are determined respec- 
tively by conditions which are invariant under deformations. Hence they 
are closed under deformations. Considering a complex analytic family of 
surfaces S, |t| <1, with p,(8;) >0, we remark that, in view of Theorem 
23, the stability of exceptional curves implies the existence of a complex 
analytic family of minimal surfaces 9;*, |t] <e such that 


Si Qn QQ (8:*), 


where e is a positive number and Q1, Qas’ ` ` Qu denote quadric transformations, 
This remark shows that the classes II,III,- - -,VI are also closed under 
deformations. i . 


THEOREM 25. A surface ts a deformation of an algebraic surface if 
and only tf tts first Betti number is even. 


Proof. If & is non-algebraic and if the first Betti number of S is even, 
then, by Theorem 22, either $ is an elliptic surface or 8 is obtained from a 
complex torus or a K3 surface by means of a. finite number of quadric 
transformations. An elliptic surface is a deformation of an algebraic surface 
if its first Betti number is eveņ (see [9], Theorem 15.2). Any complex 


8 
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torus is obviously a deformation of an algebraic surface. By Theorem 13 
every K3 surface is a deformation of a non-singular quartic surface in a 
projective 3-space. Consequently 9 is a deformation of an algebraic surface. 
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ON UNMIXEDNESS THEOREM.* 


By Wer-Lıang CHOW. 


B. Dwork and K. Ireland, in their recent work on the zeta function of 
an algebraic variety, have raised the question whether the unmixedness 
theorem holds for the doubly or multiply projective space, or rather for the 
(generalized) Segre representation of such a space as a projective variety. 
In this paper we shall give an affirmative answer to this question. However, 
in course of our investigation, it turns out that our method is susceptible 
of a bit of generalization; in fact, we shall now express our result as a 
theorem on the validity of the unmixedness theorem for the “Segre” product 
of two Noetherian graded rings, assuming that unmixedness theorem holds 
for the two rings themselves. This generalization is not nominal, for, apart 
from giving a clearer picture of the nature of our reasoning, it yields also 
some additional results of quite a bit of interest, as we shall see presently. 


1. Let V be a projective variety, defined over a field K, and let R be 
the homogeneous coordinate ring of V. We shall say that the unmixedness 
theorem holds for V, if the unmixedness theorem holds for homogeneous 
ideals in R. We recall that the unmixedness theorem is said to hold for 
homogeneous ideals if the following assertion is true: If a homogeneous ideal 
-a in R generated by + elements has the height r, then it is unmixed, i.e., has 
no embedded prime divisor. Let M be the (maximal) ideal in R generated 
by all elements of positive degrees, and let Rm be the quotient ring of R with 
respect to Mt; since every prime divisor of a is homogeneous and hence must 
be contained in W, it follows that a is unmixed if and only if Rma is unmixed. 
Now, it is easily seen that Rm has a system of parameters consisting of 
homogeneous elements in AR; hence the validity of the unmixedness theorem 
for homogeenous ideals implies that any such system of parameters must be 
distinct. Conversely, it is well-known that if Ron possesses one distinct system 
of parameters (in which case Rg is said to be Macaulay), then every system 
of parameters in Ag; must be distinct and the unmixedness theorem holds in 
Rm. Thus we see that the unmixedness theorem holds for homogeneous 
ideals in R if and only if Rm is Macaulay; in other words, the unmixedness 
theorem holds for V if and only if Rm is Macaulay. 


*This work was partially supported by the National Science Foundation under 
Grant NSF-G7030. 
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- .., Now,.let U. be another projective variety, defined.over the same field X; 
let 8 be:the homogeneous coordinate ring of U, and let N be the ideal in 8 
. generated. by all elements of positive degrees. Let T be the tensor product 
of R and § over-K; we note that both R and Scan be canonically embedded 
as subrings in T, and that their Gracies induce in T a bi-grading, so that 


T is a bigraded ring. If we set Re IB. and S == Ès where R; and S 
are- the ‘K-modules of sein, aeie of PRANE i in Rand 8 respec- 


tively, then we have T = >> Tey with Try = RSs, and the ideal D= T(M, N) 
- j= 


is the maximal: ideal i in T generated. by all homogeneous elements of positive bi- 
degrees. | As ‚we shall see later, it-can be easily shown that if both Riy and Sy 
are Macaulay, then Tp is also Macaulay. Now, T can be considered as the 
homogeneous coordinate ring of a projective variety J (V,U) which is some- 
times called the join of V and U; briefly, J (V,U) may be described as the 
variety. generated by all the lines joining a point of V with.a point of U, 
assuming that the ambient projective spaces of V and U are embedded as 
two skew linear subspaces in a third (bigger) projective space. - Thus, if 
the unmixedness.theorem holds for both V and U, then it holds also for 
J(V, U). However, we are interested here not 80 much in the join. J (¥,U) 
as in the product: variety Yx U represented projectively as a subvariety in 
thé Segre variety representing the product of their ambient spaces; we shall 
call the s0 represerited V XU the Segre product of V and U. More generally, 
we shall consider the Segre , product ya x UO, where V® and U9 are the 
images of V and U respectively under birational transformations determined 
. by the linear ‘systems of hypersurfaces of degrees `d and e respectively. The 


homogeneous coordinate ring of V® X U is the subring A:— È Tu, io in T 


generated by all ‘Homogeneous elements of bi-degrees (id, ie) for all 1—0, 
1, +; and the ideal Q= AMS is the maximal-ideal in A generated by all 
homogeneous elements of. positive degrees. Our main problem is to determine 
the condition under which the ring Ag is Macaulay, assuming: that both Rar 
and: ‘Sm are Macaulay. The conditions we shall give will be easily seen to be 
satisfied in case both R and 8 are polynomial rings over K, endowed with 
their usual. grading; and since polynomial rings are homogeneous coordinate 
rings ‘of projective | spaces, His: answers the question posea at the beginning 
of. this paper. © 

However, as mentioned aber our investigations can be extended readily 
to more general -situations. Instead of homogeneous K-algebras arising from 
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algebraic varieties, we shall only assume that R and 9 are Noetherian graded 

algebras over a common field K (with the restrictions Ro == So == K) ; it is 
easily seen that everything we have said above, except for the geometrical 
interpretations, holds without any change in this more general situation, 
provided we assume that Rp = So =K. The main point in this generalization 
is that the rings involved are no longer assumed to be generated by the 
homogeneous elements of the first degree. This last point enables us to 
apply our result to the following case, which I understand from Dwork is 
of interest in his study of the zeta-function of a complete intersection: We 
take for R and S as before the polynomial rings over K, but for one (or both) 
of these two rings we shall assign a different grading from the usual one; 
for example, if y:,: ` `, Yn are the variable generating ring S, we shall assign 
+o each y; an arbitrary positive integer g; as its degree. It is clear that this 
case is a generalization of the case of two projective spaces, and we shall see 
later that our main result remains valid here. 

We shall follow generally the terminology of Nagata in his recent book 
on Local Rings (referred to as LR) since this terminology represents what 
is now more or less standard in the field of commutative algebra. The only 
exception is that we shall speak of a homogeneous ideal in’a graded ring 
instead of a graded ideal, which is the term used in LR. For the sake of 
convenience of the reader, we shall give occasional reference to LR for some 
of the well-known results used in our argument. In this connection we should 
like to point out that, in course of our investigation, we have found it con- 
„venient to introduce the concepts of an H-local ring and of an H-Macaulay 
ring. These are natural generalizations to the case of a graded ring of the . 
usual concepts of a local ring and of a Macaulay ring, and they are more 
convenient to use in questions concerning homogeneous elements and ideals 
in a graded ring. We shall develop these notions here only to the extent 
needed for our present purpose, but it is likely that they may prove also 
useful in other connections. l = 


2. In this section we shall develop some results about a certain type 
of ideals in a Noetherian ring, which we shall need later. Let R be a 
Notherian ring; we recall that a sequence of elements u, ',w in R is 
said to be an R-sequence if R(w,-- -,,) ÆR and if u is not a zero- 
divisor for the A-module B/R(u,- - `, tla) for every ¢==1,-- -,7, and that 
this property is independent of the arrangement of the elements of the 
system into a sequence, so that we can speak of a.(finite) set of elements 
forming an R-sequence without any specification about their arrangement 
into a sequence. ote j 


802 WEI-LIANG CHOW. 


We begin with the simple observation that if two elements u and v in 
R form an R-sequence, then R(uv) = R(u) N R(v). In fact, if an element 
au in R(w) is contained in R(v), then au corresponds to the zero element 
in the R-module R/R(v) ; since u is not a zero-divisor for R/R(v), a itself 
must correspond to the zero element and hence is contained in R(v); this 
shows that au is contained in R(wv). We are interested in generalizing this 
simple result to a situation which involves two systems of edements as well 
as more intricate conditions. Let u,,-- ‚wm and V,’ + -+,v; be two systems 
of elements in R satisfying the following two conditions, where m and n 
are two fixed positive integers St: (A) Every set containing at most m 
elements among the w,,- - ‚u, and at most n elements among the v,,° - -, 0 
forms an R-sequence, and (B) the ideal R(u,,- > -,u:) is generated by any 
set of m elements among the ta,’ ',us and the ideal Av,‘ ,v) is 
generated by any set of n elements among the v` <, We set w = un, 
t#—=1,---,¢, and consider the ideal R(w,,- + ',w:) ; we shall show (Lemma 
3) that, in case t<m--n—1, this ideal can be expressed as the inter- 
section of all ideals of the form R(ty,,° + -, Uko View’ °°» U,), Where the 
indices kı,' - <, k; are a rearrangement of the integers from 1 to t. Before 
we do this, we shall first prove a result (Lemma 1) which will be useful 
to us later. In what follows in this section, we shall set for convenience 


R(u) =R (u, ` +, Un), R(v) = R (v © +3,0), 
R(u,v) =R (u, Um Vay" © Un) 
and we observe that by virtue of (B), we have the relatons 
R(u) = Ru, tu), R(v) = B(w: v), 
R(u,v) = R(t > +, ty V: u). 


Lemma 1. Asume that t£m-+n—R, and let z be an element in R 
which is contained every one of the ideals R(ur, ` "Urs Vran’ °°» U), for 
all partitions of the integers from 1 to t into two sets (h1,---,ka) and 
(kams + <, ki) and for all values of a from t—n-+1 to m—1. Then there 
exist elements C-i in R such that 


z= © td‘ Vip mod R(w) 
hoo te 


Proof. Since z is evidently contained in R(u,v), we can set z =z + 2”, 
where 7 is contained in R(u) and 2” is contained in R(v) ; we set g” = $ cwi 
4=1 
Consider a typical term cm, in z” and take an ideal 


L= R (ur, ` Ty Uka Vk” Vk) 
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where the m +1 (Sn—1) indices km,’ - -,; are to be taken among 
the integers from 1 to n but distinct from the index i; we denote by J, the 
ideal generated in R by all the elements v,,° - -,» except vj. Since z is by 
assumption contained in I, the element ca,-+ 2 u must be con- 


tained in I, +J, and hence the element cj; must be contained in R(u) + Je 
Since (R(u) +J:):R(%) =R(u) +d, it follows that c; is contained in 
R(u) +4; hence, after transferring to 7 a term belonging to R(u) if 
necessary, we can set ao un where the indices i and j run from 1 


ton. If m—2, we can stop here for we will have already arrived at the 
desired expression for z”; if m > 2, we can proceed as follows. Consider a 
typical term cyvw; in z”, and take an ideal Iy = R(uy,* ` "Uran ews” "> Uki) 
where the t—m -+1 indices km,’ ',kı are now to be taken among the 
integers from 1 to n or n+ 1 in case ¢—m-+1Sn—2 ort—m+l1>n—2 
respectively, but distinct from both i and j; we observe that since m > 2, the 
condition t—m-+-1>n—2 implies t> n, so that element Va exists. We 
denote by Jy the ideal generated in R by all the elements vı, '',Un or 
V1,‘ ‘ "3 Un in the respective case except v; and v; Since z is by assumption 
contained in Iy, the element cyvjv;-+ 2 must be contained in Iy + Ji, and 
hence the element cvw; must be contained in R(u) +Jy. Since 


(R(u) + Jy): Blu) = Ru) + Jy and (Ru) + Jy): Ro) = Ru) + Jy, 


it follows that cy is contained in R(u) + Jy; hence, after transferring to g 
a term belonging to R(w) if necessary, we can set z” = >. ciyvwvg, Where 
I<I<E 


the indices run from 1 to n or to n-+1 in case t-—-m+1in—2 or 
t—m+1>n—2 respectively. 

Thus we can proceed step by step. In general, the situation can be 
described as follows. If i— m +l=n—s+1 (28s), no new vs 
need be introduced in addition to v,,---,v, during the first s steps; for, 
as long as the degree of the expression for z” is less than s, the t—m +1 
elements vx,,,° °°, Vz, can be chosen among the v,,° > -,v, and still be distinct 
from those involved in any one given term in the expression for g’. Thus, 
after the first s steps (note that t— m -1=n—s-+1 implies sm), 


we obtain for z” an expression of the form = $, ¢y.-4,0%,' °° Us, Where 
us 
the indices all run from 1 to n. After that, if s < m, we can proceed further, 


but we need to introduce one new element among the Uns,’ U at each 
step. In fact, at he beginning of the (s-+1)-th step there are only n—s 
elements among the v,,' ' - ‚u. which are distinct from those involved in 
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any one given term in the expression for 2”; therefore we need to bring in 
Yas, to make up the set of m +i—n—s+1 elements vun," `y vx, 
and we observe that this is possible since s < m implies t—s+1>t—m+1 
—n—s + 1 and hence #>n. Generally, for any integer r such that 
s<r<m, we have after the r-th step an expression for 2” of the form 
er Cd 50, Where the indices run from 1 to n-+r—s, 


For the (r + 1)-th step, since there are only (n + r—s)— tr = n— s- elements 
among the v:,'* *, sn» Which are distinct from those involved in any one 
given term in the expression for 2”, we need to bring in Var- to make up 
the set vx,,° °°, Vx,; and again we observe that this is always possible since 
r <m implies t—r-+1>n—s-+1 and hence t>n-+r—s. ‘Thus we can 
always proceed until after m steps we obtain for z” an expression of the form 


BT Ch ty,’ © Vin; this proves our lemma. 
in 


Lemma 2. We have the relation R(u)R(v) =R(u) N R(v) ; in particu- 
lar, in case either m==1 or n==1 we have the relation R(w) = R(u) N R(v). 


Proof. To prove the relation R{u)R(v) =R(u) N R(v), we have to 
show that R(u) N R(v) is the ideal generated by all elements of the form uwy, 
for i=1,' ‚m, and j==1,--.-,n. It is clearly sufficient to show that if 

: . 

Z= >, cv; is an element in R(v) which is also contained in R(u), then we 
ja | 
can choose the elements c; so that they all are contained R(u). Assume that 
for any given integer k (0 <k <n) the elements c, with j < k are all con- 
tained in R(w), we shall that c can be so chosen (without affecting the c; 
with j < k) that it is also contained in R(u); this would of course prove 
our assertion. In fact, since z as well as all cy with j < k are contained in 
R(u), the element 040% == z — X, cv, is contained in R(u) + R(va,' + +, Un) 5 
Jrk i 
ard Since (R(u) + R (Vrs: : *,dn)) 7 R (vx) = R(t) +B (tp, * g Un); it 
follows that cs is contained in R(u) +R(vun''',Un). It we set 
Co Cx + X cv where cx is contained in R(u), then we have for z the 
I>k 
expression == >) 0; + cv + X (cy + c/vr)v, in which the coefficients of 
ê IK S>k 
all vy with 7 < k + 1iare contained in :R(u) ; our assertion is therefore proved. 
The last statement of the lemma follows by observing that, in case m =a 1, 
the element uw; is contained in R(ujvj) =R(w;) for every t—=1,---,¢ 
and hence R(w) = R(u)R(v). 
_ Lemma 3, In caset<m-+n—1, then i 
Ra N Bhi ti Vew 39u) NE(u) NE), 


? 
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where the intersection extends over all partitions of the integers from 1 to t 
into two sets. (ù, ` *,ia) and (du +, 4), for all values of a from 
t—n+1 to m—l. i 


Proof. We use double induction on the pair of integers (m, n) ; as initial 
step of our induction, we take the case where either m=—1 or n==1, and 
observe that in this case the formula (1) reduces to the formula R(w) 
=R(u)NE&(v) proved already in Lemma 2. We therefore assume that 
both m and n are greater than 1, and that our lemma holds true’ in case 
either m or n is replaced by a smaller integer. It is sufficient to show that 


(2) Rwy: > +, we) -Rlwe win) N R(wa 06). 


To see this, consider the residue ring Ë == R/R(v;) and denote generally by 
a bar the image in R of an element in R; it is easily seen that the systems 
tix,‘ eÜ and ð’ + +, T satisfy the conditions (A) and (B) with the 
integers ¢, m, n replaced either by {—1, m, n—1 respectively in case t > m, 
or by t—1, m—1, n—1 ‘respectively in case t==m. In case t>m, 
we have the inequality t— 1 < m- (n—-1)—1, while in case tm the 
inequality t— 1 < (m—1) + (n—1) —1 will also be satisfied except when 
n==2.. Thus, except when t= m, n= 2, the induction hypothesis is always 
satisfied; on the other hand, in case {=m, n==?2, we have the relation 


Kö, - +, Dia) = B(G) NRG) =Rlü,' + +, ina) NBA) 


by the last assertion of Lemma 2, which is a special case of formula (1), 
as we have just noted above. Therefore, either by induction hypothesis or by 
Lemma 2, we have the relation 


(3) R(ö, b Ūta) =N Ë (üp: n yt, Yas” 5.) 
N (t, da) NR: +, Dea) 


where the intersection extends over all partitions of the integers from 1 to 
t— i1 into two sets (i,° * ` fa) and (tau,°**,%.), for all values of a 
from ¢—n-+1 to as ey ih Going over to the ring R, we obtain 
the relation : 


Run: 3 *, Wi- Ve) = 
(4) ` N R(t, ° U Uo? " Und) NnR(u,' g "Ur, Vt) 
NR," + +, 0). 


Similarly, applying the same argument to the rseidue ring R/R (w), w we obtain 
the relation 
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R(w,' + +, Wta Us) — 
(5) NElu,‘ U Visov’ . Vja Ut) N R(n: . 4%) 
NRlvy' f *, Ura Ut), 


where 8 runs from sup(t—n,1) to m—-2. If we substitute (4) and 1 (8) 
into (2) and eliminate some redundant terms, we obtain (1). a 

To prove (2), consider an element z in R such that zu: is contained-in 
B(w,‘ > +, Wea, 0:1); We have to show that there exists an element z, in 
R(w,,' + Wia) such that zus— zu; is contained in R(wy,: - +, W). 
Going over to the residue ring Ë introduced above, our assumption implies 
that 2%; is contained in R(#,,---, M1); in view of (3), this implies 
that ai, is contained in each R(t: U a" du) as well as in 
Ry: ++, Ta). Since tiy’ + +, in sua t forms an R-sequence, it 
follows that Z must be contained in BR(%,- - -, ts, un" °°, 4.) 3 similarly, 
we conclude that 7 is contained in (D, - da). If t= m, then t,,-- +, lti 
ü, also form an R-sequence, and hence 2 is contained also in R(ih,- - -, Ūta); 
it follows then from (3) that Z is contained in R(i,,- - -, Ùt), and hence 
z is contained in R(w:,: + -, ws, 0;), so that we can take z to be z itself. 
We can therefore assume that {> m. According to Lemma 1, applied to the 
ring Ë, the element 2 can be expressed in the form #-+ 7’, where 7 is con- 
tained in R(m4,- <, Ūū) and 2” has the form 

= ĉn- tnt," Da: 
ficbm l 

Going over to the ring R, we conclude that-z = 7 + 7’, where # is contained 
in R(th,: © +, %-s,0;) and z” has the form Me 2, Ct Vh U, Where the 


indices run from 1 to t—1. Now, since u, is contained in R(u,,: <, tin) 
for every such set of indices t,,- > “, im, it follows that 1° - "vw is con- 
tained in R(w,,' ` +, Wim), and hence z”u, is contained in R(w:,: * +, Wia); 
this shows that zu,;—2’u; is contained in B(w, + -,w:1). Going back again 
to the residue ring #, we see that 2%, is also contained in R(w,,- : `, 1:1); 
hence, by the same argument as we have applied to Zi; before, we con- 
clude that 7 is contained in every B(th,: "ii, Di’ Üu) and in 
(üs + ,d61). Since 2° is also contained in Ri, - ,ü.), it follows 
from (3) that 7 is contained in R(@,: - ,@r.). Going over to R, this 
means that z’ is contained in ee +, Wea, V); this concludes the proof 
of Lemma 3. f 


Lemma 8 ceases to be generally valid in case t= m-+n—1; in. fact, in 
this case the right side of (1) reduces to R(u) N R(v), which is by Lemma 2 
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the ideal generated by all the elements of the form tv; while the left side 
can be a smaller ideal, as can be seen from the following simple example. 
Let m = n == 2, and t—3; take for %,, ua, v1, 02 any set of four elements 
forming an R-sequence, and set tis = Ur + Us, Vs = V1 +. Then K(w,, ws, Ws) 
is the ideal generated by the elements u,0;, Ust:, 12+ Uzv, Which is smaller 
than the ideal R(u) N R(v) — R (u, te) N Rvs, v2) = R(udı, 4202, UVa, Ua) 
On the other hand, it can be easily verified that every element in R(u) N R(v) 
which can be expressed as a form of degree 3 in the th, Ua, v1, v2 is contained 
in R(w,, wz, w,) ; for example, the element 


Uy? Vq = Uy (Us — Uy) Va == Uy Ugg — Ue 
. , Urt (Vs — V1) — Uy 0g = Ws — Us W1, — We 


is contained in R (w, W2, W3). Therefore, if we denote by R(w, (u, v)*) the sum 
of the ideal R(wı,%s, ws) with the ideal R (u1, t2, v1, v2)?, we obtained the 
equation R(w1, wa, w) = R(w) N R(v) N E(w, (u, v)*). In case R is the poly- 
nomial ring K[t1, ts, 01,02] over a field K generated by the indeterminates 
Ux, Us, V1, V2, this equation gives a primary decomposition of R (w1, ws, ws), in 
which R(w, (u,v)*) is an embedded component belonging to the maximal 
prime ideal R (ui, uz, v1, 02).. The situation we have just described holds in 
general for t==mjn—l. i 


Lemma 4. For t=m-+-n—1, we have the relation 
(6) R(t," ` +, w) =R(u) NE(v) N R(w, (uv)*), 
where R(w, (u,v)*) = R(w,: > <, w) + R(u,v)*. 


Proof. It is sufficient to show that every element z in R(u) N R(v) 
which is a “monomial” of degree t is contained in R(w,---,w;). Since 
f = m + n— 1, the monomial z must have either a degree =n in the w’s or 
a degree = m in the v’s; assume the first case and. set z= at, > - "uU. We 
maintain that every such. monomial can be expressed as a sum of such 
monomials in which all the indices ù,’  ‘,*, are distinct. In fact, assume 
that ù, * ‚ta (a <n) are distinct and let k,,- - >, km be m distinct. positive 
integers St which are distinct from t,---,t (observe that t—a = m), 
then we can express every one of the factors uw,‘ ° -,t, in z by a linear 
combination of Ur,‘ ` ‚tür, and obtain an expression of z as a sum of 
monomials each of which contains at least «+1 distinct ws; after a finite 
number of steps, we arrive at an expression of z as a sum of monomials each 
of which contains n distinct u’s. Thus we only need to prove our assertion 
for the case where the indices t, - -, ia in the expression for z are distinct; 
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but. in this case we can express v; as a linear combination of Vis `, *, Ui Bay 
vy = bat +: eee bat, and obtain. the equation . . 


g= u u, (DVi +4 bnth) : Br 
sels ee Wy E + abat À Ur Win . 
which shows “that z is contained in Ru,‘ % <, w). 


, Bemärk: ‘Since the above proof uses only the condition (B) but not the 
condition (A), Lemma 4 therefore holds also without the condition (A): 


8. Let R be a Noetherian graded ring, and let R— SR; be the expres- 
0 


sion of R as a direct sum of modules of homogeneous elements of, different 
degrees; it is clear that Ro is a Notherian subring in R and that each R; 
is also an R,-module.' We shall say that R is H-local if it has only one 
maximal homogeneous ideal. It is easily seen that È is H-local if and’ only 
if the subring I» is local, and that if-such is the case and if M is the 
maximal homogeneous ideal of R, then M, =R, NM is the maximal ideal 
of the local ring Ry. The concept of an H-local ring is a natural generaliza- 
tion of that-of a local ring (and reduces to it in case R=R,); and as such 
it has many of the properties of a local ring provided we consider only 
homogeneous ideals. We shall introduce here some notions and a few results 
about an H-local ring which we shall need.for our present purpose; these 
results can be proved easily by generalizing the proofs of the corresponding 
results for a local ring, but it is even easier to derive the former from the 
latter by using the basic relation a= R N Rma for any. homogeneous ideal a 
in R. This relation a= R N Rma for a homogeneous ideal a in R follows 
from (and is in fact equivalent to) the well-known fact (LR, 8.7) that every 
homogeneous ideal in R has a primary decomposition consisting of only 
homogeneous primary ideals, which together with their associated prime 
ideals must then all be contained in M. If m is the height of the maximal 
homogeneous ideal M of an H-local ring R, then a system of elements 
T’ "+, 2, in R is said to be a system of parameters for M if the. ‘ideal 
Ra, +, ag) is primary for M; and a system of parameters for M is said 
to be distinct if it forms an R-sequence. ‘We shall consider here only system, 
of homogeneous parameters for M, i.e. a system of parameters consisting of 
homogeneous elements in B; then the relations `` 


R(t: i u) RA R(t: o s a). 


ie eS 


for ¢—=1,- - ‚m, show that a system of homogeneous elements %ı,° oc Im 
in. R'is a.system of parameters for M if and only if it-is’süch for Rog, and 


ON UNMIXEDNESS THEOREM. 809 


that such a system of parameters for M is distinct if and only if it is distinct 
as a system of parameters for Rm. It follows then from a well-known result 
for local ring (LR, 25.5) that if one system of homogeneous parameters 
for M is distinct, then every system of homogeneous parameters for M is 
distinct. We note incidentally that the definitions given here are compatible 
with the terminology in LR provided the elements a,---,@m_ are homo- 
geneous; without the homogeneity condition, our definitions would be some- 
what stricter than those given in LR. 

We shall be concerned in this paper only with the special case of an 
H-local ring R where R—K is a field; equivalently we can characterize 
this case by the condition that all homogeneous elements of positive degrees 
in R generate a maximal ideal M in R, which must then be the only maximal 
homogeneous ideal in R. A simple but important consequence of this assump- 
tion is that, if m is the height of M, then there exist homogeneous elements 
Z,°* *,@m in M such that the ideal R(a,,---+,2,) has the height r; this 
implies in particular that 24,---,%, form a system of homogeneous para- 
meters for M, since Mt is the only homogeneous prime ideal in R having a 
height =m. We shall prove this assertion by induction, assuming that the 
homogeneous elements 2,---,2, (r <m) have already been chosen in M 
so that R(z,,--+,2,) has the height r. Let pa`- ‚ds be the minimal 
prime divisor of R(2,,:--+,2,) having the height r; we recall that they are 
all homogeneous ideals and hence are all contained in Mt. Consider any one 
ideal p; ; since p; does not contain a p; and since both ideals are homogeneous, 


there exists a homogeneous element z; in f) p; which is not contained in p 
i : Eau 


Let dı be the degree of the homogeneous element 2, (observe that z; as an 
element in DM has a positive degree), and set c= d,- > -d,/d;; then the 
element 21% + --+2,% is & homogeneous element (of degree di: - -d,) 
in M and is not contained in any one of the ideal p,,---+,,. If we take 
this element to be mı, then clearly R(z,,* - *;2,..) must have the height 
r-+1; this proves our- assertion. aa 

An H-loċal ring R is said to be H-Macaulay if its maximal homogeneous 
ideal Yt has a distinct system of homogeneous parameters. The existence of 
a homogeneous system of parameters for M in the special case R, = K 
enables us to prove the following lemma; without the assumption Ro = K, 
the “if” part still holds, but the “only if” part would be no ana generally 
true, as will be shown by a simple ‘example below. 


Lemma 5. Let R=SR, be a Notherian graded ring such that Ry is 
io 
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a field; then the unmizedness theorem holds for homogeneous ideals in R tf 
and only tf R ts H-Macaulay. 


Proof. I£ R is H-Macaulay, then Rm is Macaulay and hence the 
unmixedness theorem hold in Rm; the relation a = R N Ema for any homo- 
geneous ideal in R shows that then the unmixedness theorem holds for 
homogeneous ideals in R. Conversely, assume that the unmixedness theorem 
holds for homogeneous ideals in R, and let z,,' - +, m be a system of homo- 
geneous parameters for the maximal homogeneous ideal W in A, with the 
property that R(a,,---,2,) has the height i for t1,---,m; we have 
just noted above that such a system of homogeneous parameter exists. Since 
R(T, + +,%1) has the height i—1 and does not have any embedded prime 
divisors, all its prime divisors must have the height 1—-1; it follows then 
- that z; is not contained in any of the prime divisors of R(x,,---,a%.) and 
hence is not a zero-divisor for the R-module R/R (z1, * -,%1). This shows 
that the system of homogeneous parameters %,-- ',£m is distinct, so that 
R is H-Macaulay. 

To show that an H-local ring does not necessarily have a system of 
homogeneous parameters for its maximal homogeneous ideal, even when 
the unmixedness theorem holds in it, consider the following example. Let 
Plz]=Pf[x,' + ',zm] be the polynomial ring of m variables over a real 
discrete valuation ring P, graded as usual by assigning to each variable zı 
the degree 1; it is clear that P[z] is H-local, and that if t is a generator 
of the maximal ideal in P, then the maximal homogeneous ideal in P[r] 
is generated by the m-+1 elements @,: * *,zm,i. Furthermore, since the 
elements Tı’ ' ‚2,2 clearly form a P]z[-sequence, they form a distinct 
system of homogeneous parameters for the maximal homogeneous ideal in 
P[z], so that P[z] is H-Macaulay. (In fact, it is well-known that P[z] 
is locally Macaulay.) Now, let n be the homogeneous ideal in P[x] generated 
by the single element tz, and consider the residue ring R==P[z]/n; it is 
clear that R as a graded ring is also H-local and that the maximal homo- 
geneous ideal M in R is generated by the images %,:--,#,,Z in R of 
Ty," * `, 2m É respectively. The relations Ëm’ = Zn(Zm-+ #) and # = (Em -+ F) 
show that the ideal R(%,,- © +, %n+,2n-+#) is primary for M; on the other 
hand, since the ideal R(%,,- > -, Zm) has the height m—1 and since Ëm +7 
is not contained in either of the two prime divisors R(%,,- * >, Žm-1 m) and 
B(2,° + +, %m1,#) of R(%,* <, Zm), it follows that M has the height m 
and hence the elements Žu - +, @m1+.2n-+# form a system of parameters for 
M. In fact, our argument shows that Ëm- is not a zero-divisor for the 
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R-module R/R(a,,: - `, mı), and since ä; is evidently not a zero-divisor for 
the R-module R/R(ä,‘ 41.) for ¢==1,---;m—1, it follows that 
Ey, m+f form a distinct system of parameters for M. This 
implies that Em is Macaulay and hence the unmixedness theorem holds in 
Rm; and the basic relation a==RM Rma for any homogeneous ideal in # 
shows then that the unmixedness theorem holds for homogeneous ideals in R. 
However, since the element m + È is not homogeneous, the system Ë,- ‚Im, 
Em + is not a system of homogeneous parameters for Yt; in fact, we main- 
tain that such a system of parameters cannot exist. For any system of 
homogeneous parameters for M cannot consist of positive degrees only, for 
then all elements in the system would be contained in R(4,,- ' +, 4m), which 
has the height m—1. On the other hand, if such a system contains a 
homogeneous element of degree 0 in M, the image system in the residue ring 
R/R(f) contains less than m non-zero elements and yet must generate an 
ideal which is primary for the ideal M/R(t);, but this is impossible, for 
R/E(t) is isomorphic to the polynomial ring of m variables over the field 
P/P(t) and in this isomorphism the ideal M/R(t) corresponds to the ideal 
generated by the m independent variables. 


Let R == NR, and § = 5 S; be two Noetherian graded rings which both 
i= iz 


contain the same field K and satisfy the condition R, == So == K; in other 
words, R and S are Noetherin graded K-algebras which both contain K as 
the subring of all homogeneous elements of degree 0. Let M and N be the 
maximal homogeneous ideals in R and S§ respectively, which we recall are 
the ideals generated by all homogeneous elements of positive degrees in R and 
S respectively. Consider the tensor product T—=R®S of R and 8 over K; 
as usual, we shall consider both R and S embedded canonically as sub- 
algebras in T, so that the tensor product between elements in R and 9 can be 
expressed as ordinary product in T. The gradings of R and S induce in a 


natural way a bi-grading of T == 3 Tj, where 7, is the K-module generated 
4,5=0 € 


by all products of homogeneous elements of degree i in R with homogeneous 
elements of degree j in S. An element in T,; will be said to be homogeneous 
of bi-degree (1,7), and the bi-degree (t, j) is said to be positive if either i or 
j is positive; we note that 7,.=-K and that © == (M,N) is the maximal 
prime ideal in T generated by all homogeneous elements of positive bi-degrees. 
Furthermore, we-can make T into a graded ring by assigning to each element 


in T;,; the degree i- j, so that we can set T—3T; with yo $ Tiz; and 
i= pkai 
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we note again that 7,-=K and that © is the ideal ‘generated in T. by all 
homogeneous elements of positive degrees., ae 


LEMMA 6. ‚If ah, "ln 18 an R-sequence in R ind bus‘ “ybs is an 
S-sequence in 8, Mon t `, ür, bs,” yb, is a T-sequence in T. 


Proof. We use induction on the total number r- s, the assertion ben 
trivially -true in case r==s— 0. Since by induction hypothesis the system ` 
Gy day‘ +, bg is already a T-sequence in T, we have only to show 
that b, is not a zero-divisor for the T-module T/T (a,: + +, dy, bi: + +, bea). 
Now, there is a ring isomorphism between 7'/7'(a,,- * `, ar bu’ > +, bs) and 
the tensor product (R/R(a,,‘ ` -,a)) @ (8/8 (bu: ` +, be1)),.and the image 
of b; in 8/8 (bu: 7, bs) under the canonical mapping is by assumption 
not.a zero-divisor ; our assertion follows then from the fact that in the tensor 
product of two algebras over a field any topoa element in one of the algebras 


- cannot become a 'zero-divisor. 


An almost immediate consequence of Lemma 6 is that if both #& and 8 
are H-Macaulay, then the tensor product T is also H-Macaulay. In fact, if 
the system T1, * `, 2m is a distinct system of homogeneous parameters for. W} 
and the system Yı,° ' *,yn is a distinct system of homogeneous parameters 
for N, then the combined system T sEm Y © sYa is by Lemma 6 a 
‘T-sequence in T; and since this combined system evidently generate in T 
an ideal which is primary for the ideal O == T (M, N), it is a distinct system 
of homogeneous parameters for ©. Geometrically, this implies that- if the 
unmixedness theorem holds for two varieties U and V, then it holds also 
for their join J(U,V). 

As mentioned before, we are | here not so isch in the tensor 
product as in what we shall call the Segre product of R and S over K. 
For any pair of positive integers d and e, we define the Segre product of 
order (d,e) of R and S over K to be the Noetherian graded subalgebra 


A= ZA È Tau in the tensor product 7’; for brevity we shall'simply 


speak ¢ of the Bogre product of R and § in case the base field K as well as 
the order (d,e) are clear from ‘the context. We observe that the grading 


of 4 is induced not only by the grading of T asa a graded ring FT, 


but also by the bi-grading of T as a bi-graded ring T= 2 Tip only in the 


latter case the induced bi-grading of A becomes a simple caiie on account l 
of the absence of any elements (except 0) of bi-degrees -different from the 
form (td,te). It is clear that Ao =K, and that the ideal 2=ANOD is 
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the ideal in. A: generated by all homogeneous elements of positive degrees and 
hence-is the maximal homogeneous ideal.in A. 


: We wish to construct a system of parameters for the ideal g consisting 
of homogeneous’ elemerits of the same degree in A. “As we have ‘shown before, 
` there exists a system of homogeneous parameters for the ideal -M. in--R; 
moreover, by replacing each element in such a system by a suitable power 
of itself, we can obtain a system of parameters for M in which every element 
is homogeneous of the degree fd, where f can be any multiple of a suitable 
positive integer. | Similarly, we can obtain a system of ‘parameters for N 
consisting of homogeneous elements of degree fe in 8, where f again can ‘be 
any multiple of a suitable positive integer. We now take for f an arbitrary 
but fixed integer which satisfies both these conditions; let 24," © *, 2m be a 
system of parameters for Dt consisting of homogeneous elements of degree fd 
in. R, and. let -y,,---,¥, be a system. of parameters for N consisting of 
homogeneous elements of degree fe in S. Next, let t,° * "mm. be linear 
combinations in the 2,:--,@m with coefficients in K such that every m 
elements among them are linearly independent (as linear forms over K); 
it is easily seen that then every m elements among the t,- - -,Umm1 form 
also a system of parameters for M. Similarly, let 94,° ---,tmun—+. be linear 
combinations in the y:,---,y, with’ coefficients in K such that every n 
elements among them are linearly independent (as linear forms over K ); 
‚then every m elements among the-v,,- - ",Umm-ı form also a system of para- 
meters, for M. In order to insure the existence of these linear combinations, 
we shall assume that the field K contains sufficiently large number-of elements 
(for fixed integers m and n),.e.g., K is infinite; however, this restriction is 
not sérious,.for not only can it often be met in applications by a change of the 
ground field, but also it can be removed in the general case by the usual 
trick. of OOR ‘of a variable to the field K. Now, we set D= uw, 
vol, io mH n—1; it is clear that w, : +, Wmm- are all bi-homogeneous 
elements of :bi-degree (fd,fe) in T and hence are homogeneous elements of 
degree f in. A.. We shall show presently that Wi, Wu form a system 
of parameters for &. Before. doing this, we. shall prove a few lemmas con- 
og the -relations between: the ideals in T ‘and the ideals: in A. 


Jaaa A - For any ideal a in A, we kave the relation Ai N Ta=a.- 

Er ‚Let B be the K-submodule in T generated by all Haaren 
dint of bi-degrees not of the type (ld, le) for any l; then we have the 
direct sum T ==A -+B as K-modules, and it is easily seen that B. isalso 


9 
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an A-module. ::Now, let @,'.' ',ar be a base of r ideal a,:and let 
2 Dom be an element in AN Ta, where the & are elemente in T. If 
we ae af Fa ’, with of in A and &” in B, then we have the relation 


s=% nt 2’; since Sa'a is an n element in both A-and B, it et 
= equal to 0. Therefore t= x c/a,, which shows that z is in a. 


.. Lamm 8 If Bis a bi-homogeneous prime ideal in T which does. not 
contain either TI or TN, then P is the radical of T(A N $). 


Proof. Since ® does not contain either TI or TR, it canngt ‘contain 
all the z; or all the yi; we can therefore assume that, say; x; and y, are not 
in P. Let E be the multiplicatively closed set generated by 2; and Yr, 
i.e, E is the set of all monomials in z, y+; since Æ- does not intersect 
SS, we have the usual relations of a quotient ring, T N Ts — and 
TNA(TsANP))=T(ANB). Let pi,‘ ',p. be a base for $ consisting 
of bi-homogeneous elements, and let (g1,A%,),‘ * *, (Ys) ha) be their bi-degrees 
respectively; then, using the notations introduced above, the ideal AM 
‚contains the elements p,@fa™y,°7, i= 1,: --+,8, for they have the bi-degrees 
(af (eg: +--dh,), ef (dħ -+-eg,)), i= 1, + -,s, respectively. Then it is easily 
seen that Ty(4 NP) must contain the elements ptt, i= 1, ~+ ,8, and hence 
T(A NB) = TO (Ta(ANP)) must also contain these s elements. This 
shows that $ is. contained in the radical of T(A NP) and hence must 
coincide with it. 


Lemma 9. If P ts a bt-homogeneous prime ideal in T which does not 
‘contain either TW or TM, then B and ANP have the same height. 


Proof. Any chain of distinct prime ideals P D P, D - - - D Yr. will con- 
tract in A to a chain of prime ideals ANBPDADP,D--- DAN, and 
Lemma 8 shows that the ideals in the latter chain must be distinct; hence 
the height of P is not. greater than that of ANP. To prove the converse, 
consider first a prime ideal p in- A; it follows easily from Lemma 7 that 
there must be at least one minimal prime divisor ®’ of Tp which contracts 
in A to p. By Lemma 8, $ coincides with the radical of Tp and hence must 
be the only minimal prime divisor of Tp. Now, if ANPIPD---Dh is 
a chain of distinct prime ideals in A, then we can obtain a chain of prime 
ideals P D P D- - -D P in T such that each $; is a minimal prime divisor 
of- Tpi; it follows from what we have just shown that each {% is the unique 
minimal prime divisor of Tp; which contracts in A to p, and hence the ideals 
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in the latter chain must be distinct. This shows that the Height of ANP 
is not greater than that of PB. 


Lemma 10. The elements wi,‘ +--+, Wam+s form u. system of homo- 
geneous parameters for maximal homogeneous ideal Q in A. 


Proof. We can choose the system 21,°--,%m so that R(T, > -,2,) 
has the height r for every r= m, and choose the system 4,,- * *,Yn so that 
E (Y © >, Ya) has the height s for every sn; then it can be shown that 
T(t © 21,41," ',Ys) has the height r-+s (the proof is simple, but we 
shall not go into details here). In particular, the ideal T(z," > <, Ema 
Yip" © +> %n-1) bas the height m+ n—2, and hence (LR, 9.3) every one of 
its minimal prime divisors must have the height m+n—2. If $ is any 
one such prime divisor, then PB cannot contain the element tmy,; for, 
otherwise P must contain either t, or Yn, which would imply that either 
T (a, sEm Yrs" © Yna) OF T(t, "yma, Yn * Yn) must have the 
height m-+n—2. Since we can choose the ws and the v’s so that w = wv; 
(or any other w,) is equal to tmyn mod T (t` ` `, Emo Yu" ° > Yaa), it 
follows that X cannot contain w, and hence the ideal AMS is a proper 
subset in Q. Now, since P does not contain either TM or TM, Lemma 9 
shows that A NY must have the same height m +n— 2 as $ itself; this 
shows that the height of Q must be at least m +n—1. On the other hand, 
it is clear that the system ta,’ - -,tUmsn-1 and Vi: °°, Vmin- introduced in this 
section satisfy the condition (B) in Section 2 (with t=-m-—+n—1); hence 
we can apply Lemma 4, by the Remark after that lemma. The application 
of Formula (6) in Lemma 4 to our present situation shows that 


T (w1 Wan). = T (2) N Ty) AT(w, (z,y)™*"*) 5 
hence, by Lemma 7, we have the decomposition 


Alw,,' x “y Wmsn-ı) An T (w: ! Wma) 
= (A N T(£)) N (AN T(y)) N (4NA T(w, (z, y)" 1), 


Since it can be easily seen that a sufficiently high power of every element in 
Q is contained in every one of the three ideals appearing in the expression 
on the right hand side of this equation, it follows that A (w01, `> +, Wmsn-1) 
is primary for 2. This shows that the height of X is at most m + n—1 
and hence must be equal to m + n— 1; therefore the elements w, ` `, mint 
form a system of homogeneous parameters for &. 


4. Our aim is to investigate the validity of the unmixedness theorem 
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for Homogeneous ideals in:the Segre product A of R.and S, assuming‘ that 
the unmixedness theorem holds for homogeneous ideals. in both Rand: g. 
It turns out. that a certain additional condition on both R and 8 has to be 
introduced, which. proves to be both necessary and sufficient (except in some 
very special cases). In order to be able to formulate’ our result bones 
wo shall. first make. a’ few remarks about- this condition.. 


„Aa before, let ROS, be a Noetherian graded ring with BEL and 


let M, be: the ideal ai in R by all elements of. positive degrees. -For 
simplicity, we shall call a system.of parameters for M homogenéous if it 
-consists of homogeneous elements of the same degree in R, and this common 
degree. is.then called :the degree of the system. Let zi, - -,2m be's Bomo- 
geneous system of parameters of degree fd forM ; we.shall say that this system 
has ‘the d-exponent e. (or simply the exponent e in case d=1) if e is the 
smallest integer with the property that every homogeneous element -in R of 
degree ld with |= ef is contained in R(z,,---,%m). In case R is a homo- 
geneous. ring. (i.e, Wis generated by homogeneous elements of dsgree. 1) 
and fd==1,.then the exponent of the homogeneous system of parameters 
Ti, ' y Tẹ is simply the exponent of the primary ideal R(z,, -© '‚zw). We 
shall, show, that, under. the assumption that R is H-Macaulay, if any one 
homogeneous system of parameters of degree fd for M.has the d-exponent e, 
then. every homogeneous system of parameters of degree fd will have the same 
d-exponent. e It is sufficient to show that if the system 2,° ` :, =. has: d- 
exponent Se, then. the same is true of the homogeneous system of parameters 
@1,* "5m, Z obtained from it by replacing £m by. another homogeneous 
element of degree fd i in R. Let a be a homogeneons of degree Id in R with 
= ef; since the ideal R(T + *,@ma,2) is primary for WM, there is'a 
positive integer -such that az,_°'is-contained in Er | 7,212). We have 
then: -a relation of the: form: Am me Oy Ly +: -oF Gm-ıTm-ı F amz, where 
44,‘ © *, am are homogeneous. elements of degree- (+ Bf— f)d in R: Since 
(-HAf—f)Zef, we have. the relation some ++ but, by our 
assumption ‚about the d-exponent of the system a1,‘ ` -,¢m. Combining these 
two relations, we obtain the relation (a, + bız) +: -+ (ama F bnat) Zm 
+ (bine — Am) Em = 0, .from which we conclude that Du — azn is con- 
tained in-R(21,~ : + jam) and hence. atm is contained in Rz,‘ ` *; 2m, 2). 
We, can-then-repeat the same argument for az,*, and conclude after B.steps 
that a itself is contained in R(ai;- ++, Ema). | 

vo At-is easily seen that the ‘d-exponent does not in general remain 1 unchanged 
it. al replat: a homogeneous. system of parameters for M of degree. fd by 


ON UNMIXEDNESS THEOREM. 81? 


anotlier one of degree fd with a different jf’. On the other hand, we ‘shall 
show that,.always under the assumption ‘that Ris: H-Macaulay, if. any ‘one 
(and hence every). homogeneous system of parameters of ‘degree fd.for M 
has a d-exponent < = m, then the same is true for every homogeneous system 
of parameters of degree f’d for’ any f. It is clearly sufficient to show this 
for the case where either f is a multiple of f or f is a multiple of f; futher- 
more, in view of what we have just shown above, it is ‘sufficient to show this for 
any two particular homogeneous systems of parameters of degrees fa and jd. 
It is therefore sufficient to show that the system 2," ` `; Em has `a ‘d-exponenit 
=m if and only. if the system a, +3 Et (ip any paie Integer I: has 
a ‚dexponient S sm 

“Assiime first that ‘thé system Ty i, Zm has a jax Eg m, and let 
à be ‘a homògeneous element of dogiee ld with 1= msf. ` Since’ evidently 
1==mf we have the relation a == aiti + "Anm, Where as .* gam are 
homogeneous elements of degree (1—f)d; since 1—f = (s-— Linh = mf, the 
elements @,°--,@, are themselves contained: in R(z,' '.",2un): ‘Thus 
proceeding in this way, we conclude after 8—m(s—1) +1 ‘steps’ that 
a= N ayati * "Zi. Since every term in this expression must contain 
the s-th power.of at least one of the’ z,, it follows that a is contained in 
B(T, >+, 2m’). Conversely; assume that the system: z,%,- ‚im has a 
d-exponent <= m, and leta be a ON element of degree ld with 


l= mf.. Consider the product a(z, + ")*",: which is: a “homogeneous 
element of degree (l+ (s—1)mf)d; since 14+ (s—1)mf = msf,, this element 
ala,‘ * Tm) must be contained in R(a,8,* - Em), 80 that we have the 
a: : ae = 3 aa. If a were not contained i in Bas: 2 to) then this 


ETA could = when as a non-trivial relation. in the,’ "°, £m with 
coefficients which are not in R(z,,° ` *, 2m); in fact this ee not 
be trivial (i. e., both sides being identical as forms in-the T1, * *:',zm) because 
the left side could contain no s-th power of any one of: the.a,,-: -, 2, while 
each term in the right side would contain the s-th- power of at least one of 
them. . Since such a relation cannot. a > 25. ia we ne that a 
must be’ contained in R(21,- : *,m)-: ey au toi! 
Thus we have shown that the property of having a ‘despouent = Sm is 


(provided of course it has a dense which is’a dultintecot Pe can 
be- considered as a property of the H-Macaulay graded ring R itself: “We 
shall express this property by saying that the. H-Macaulay ring: Rris:.d-proper, 
or simply proper in case d—1. It is easily seen‘from onr'-above argument 
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that if R is d-proper, then it is also d’-proper for any d’ which is a multiple 
of d; in particular, if R is proper, then it is d-proper for every d. , 
We are now in a position to prove our main theorem. 


Turorem. Let Rand 8 be Noetherian graded K-algebras with Ry = 8o 
= K, and let m and n be the heights of the prime ideals generated by all 
the homogeneous elements of positive degrees in R and 8 respectively; 
we assume that both R and S are H-Macaulay. Then the Segre Product A 
of order (d,e) of Rand 8 over K is H-Macaulay if R is d-proper (unless 
n—1) and 8 is e-proper (unless m == 1); and this condition ts also necessary 
in case R and S contain non-zero homogeneous elements of all degrees 
which are multiples of d and e respectively. Furthermore, when R and S are 
respectively d-proper and e-proper, then the H-Macaulay ring A. is proper. 


Proof. Using the results and notations developed in Section 3, our 
theorem, except for the last assertion, is equivalent to the statement that the 
system of parameters w, *', Wm for Q is distinct if and only if the 
stated condition is satisfied. Now, as we have observed before, the system of 
parameters w,,° ° +, Wmin-1 18 distinct if and only if the ideal A(w,,-.- -, w) 
is unmixed for every t—1,---,m-+-+-n—2. By Lemma 7, we have- the 
relation A (w: ` +, w) = ANT (w, -,w:); therefore, if T'(w,,: - +, w) 
= n Q is a (not necessarily shortest) primary decomposition of T (w'<, w), 


i.e., a representation of T’(w,,' - -,w;) as an intersection of primary ideals, 
then A (w: <, w) = (A N Q) is a primary decomposition of A(w1,---,w;). 
i f Er 


In order that A(wı,* - ‘,wı) be unmixed, it is therefore necessary and sufi- 
cient that every ideal AN ©; which is not redundant in the primary decom- 
position has the height 2. 

We now apply the results of Section 2 to the ring T, and observe that 
the systems U: `’, Ut and V’ * -,v, as constructed in Section 3, satisfy 
the conditions stated in Section 2. We note here a small discrepancy in 
convention between Section 2 and our present situation, namely in Section 2 
the integer ¢ is always not less than m or n, while now ? may be any integer 
from 1 to m-+n—2. However, this discrepancy in convention can be easily 
taken care of; for, in case ¢ is less than m or n, we can replace m or n 
respectively by t, and one verifies easily that this change of m or n will not 
invalidate the inequality Sm -+n—2 except when n==1 or m ==] respec- 
tively (after the change in case both m and n are changed). Therefore we 
can apply formula (1) of Lemma 3 to our present situation for all values 
of t from 1 to m-+n—2: i 
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Tu, ,w) = 


A T(t: U View’ ` u) N Thu j ,u)N Tv, ° u), 


(7) 


where the intersection extends over all partitions (+) of the integers from 1 
to # into two sets (t41,°°-,tx) and (teu,:--,%), for all values of a from 
sup(t—n+ 1,0) to inf(m—1I,t). We observe that in case t < m the term 
Tu,’ :,%) no longer coincides with T(un' ` `, um) = Tl,‘ * +, 2m) 
and is in fact redundant in (7); a similar statement holds of course for the 
term T (v, © -,v:) in cade t <n. a 

Now, since each ideal T'(ui,: "u, Piw ‘> Ui) is generated by t 
elements in a distinct system of parameters for ©, it has the height ¢ It 
follows then from the validity of the unmixedness theorem for homogeneous 
ideals in T that this ideal has a (shortest) primary decomposition 


a(i) 
Tu U Yeas” ” nw) =f Do. 
in which every ideal Q, has the height ¢. Furthermore, since this is a 
bi-homogeneous ideal in T, every ideal Q«,,; is also bi-homogeneous. If we 
assume for convenience mn and set T(t) == T (t, ` ',2.) and T(y) 
=T (yy ` *3Yn), then 


N | 
T(w, jw) = N Oa. (t<m), 
a(i) . 
eal N Qa N T(z) (m<t<n), 
ad) 
= Dyin P(e) NT) (nS). 


If we set u; = Á N Day,5, then it follows from the relation A (w, -~ w) 
= AMT (w: >, w) that 


a 
Alu, +, w) = n [laos (t< m), 
: a(i) i 
(8) . = q AECE N (AN T(z)) (mSt<n), 


. =n f aasN (4N TE) N (ANTO) (nst). 


‚Since all the ideals Oj); are bi-homogeneous and none of them contains 
either TM or TN, it follows from Lemma 9 that the contraction Gay, in A 
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of every Quz has the height 1. On the other hand, it is clear-that both 
AN;T(z) and ANT(y) are primary ideals for.2, for a sufficiently. high 
power of every element in & is easily seen-to be contained in both AM T(z) 
and: AN T(y).: It follows then that A(w,,-  -,w:) is unmixed: if-and-only 
if the ideal AM T(x) and AN T(y), whenever' either or both -octur: in ‘the 
above primary decomposition. of A (w. <, +), are in effect. redundant. 
We have therefore to: prove that this is so. if and only if the stated- gondition 
is šatisfed.. 

Consider the ideal A N T(z). Mn}; then i<m ne A nIe 
does not appear in the right side of (8), so that there is nothing to ‘prove. 
Assume that-n > 1, and take t= m (which is possible in case n > 1),; let z 
be any element: in A which is contained: in, every one. of the idebls hes) 4: 
Since z is evidently contained in every one-of the ideals; T (tin 1” :1, Un, 
Vina’ © Vu) appearing in the expression on the right side of (7), it follows’ 
from Lemma 1 that z.is mod T(x) equal to a sum of elements of the form 
ct, ° "0. Furthermore; since z is contained in A, each such element l 
Uy! + Ug must itself be a sum of terms of the form aby,- ; * Vimy. Where .a 
is a homogeneous element of. degree ld i in R with- I= mf,. and. b. isa homo- 
geneous element of degree (1—mf)e in 8. . Conversely, if a is any homo- 
geneous element of degree ld in R with 1= mf, and if we take for . b ‘any 
homogeneous element of degree (}— mf)e in 8, then the element abv,” Vim 
is contained in every ideal T (up "un You’ " "svu ) appearing in the 
the right side of (7); and since this element has the bi-degree (ld, le), it js 
contained in A and hence is contained in every one of the ideals qyy,;. There- 
fore, the ideal A N T(z) is redundant in (8) if and only if for every homo- 
geneous element a of degree ld in R with I= E oe element abv,’ *.* Din is 
contained in T(z), for all choices of'b and vm + Uim- We recall now that, 
for any ideal a in R, the product of an element a in R with a ‚non- zero 
element in 8 is ‘contained in Ta if and only if a itself is contained i in a; in 
fact, in view of the canonical isomorphism T/Ta— (B/a) 85; this follows 
from the well-known fact that the product in 7’ of'a non-zero element in R 
with a non-zero-element in 8 cannot be zero. If we apply this to the ideal 
E(x) in R and observe that bv,’ > -vin is a non-zero-element in S, we conclude 
that. AN T(z) is redundant in (8) if and ‘(in case 8° contains non-zero 
homogeneous elements of all degrees which are multiples of e) only if every 
‘homogeneous.element of degre id in R with 1= mf is containd in R(2), i.e., 
is d-proper. Similarly, we can show that, unless m—=1 (in which case 
-there is no condition), the ideal AM 7'(y) is redundant in ‘(8) if. and (in 
‚case R contains non-zero homogeneous elements of all degrees which’ are 
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multiples-of d) only if S: is N This Fee our theorem except for 
the last assertion, . .-- = os 

-To prove the last ee spain a hojasi a z ‘of en 
L in A with ¿= (m-+n—1)f; since z as an element in T has the bi-degree 
(ld, le) and hence is a sum of elements of the type ab, where a and b are 
homogeneous elements of degrees Id and le in R and 8 respectively, it is 
sufficient to.show every such element ab is contained in 7'(10,,-.-.+, Umma) 
Since R is d-proper and-we have the inequality 1 = mf, the element a is -con- 
tained in R(x) and hence can be exprssed in the form a — 2, aay where the a 


are homogenous elements of degree (1—f)d in R. If n=1, then we stop 
here;'if, n>1, then 1—f2 mf and hence each a can be expressed in ‘the 
form u so that we can set a = D tipt pip where the hy are homo- 


; geneous Teen of degree. (1—2f)d i in R. Thus proceeding in this manner 
we obtain after n steps an expression for a of the form 


at = „en Bi u 
Simian, we can j obtain for the element b an expression of the form’ 
N b— a, ba "ImYh' Yim 


Then the element ab can be a as the sum of elements each of which 
is a monomial of degre m+n in the vs and y’s; hence, ab is contained in 
the ideal T (w, (u, v)™*), in the notation of Lemma 4. Since ab is evidently 
contained in both T (s) =T (u) and T(y)—=T(v), it follows from Lemma 4 
that ab is contained in T (wma). 

We conclude this paper by giving a few samples of the application of 
our result. Let R=Kf[z,‘ : ',zm] be a polynomial ring generated by m 
variables 2,,-- *,@», over a field X. The usual way of making R into a 
_ graded ring is to assign each variable z; the degree 1; we shall generalize the 
the situation here by assigning each variable a, an arbitrary positive integer 
dy as its degree, so that a’ “monomial” of the form 2": - -dg’" is a homo- 
geneous element of degree rid, ++ rmda in R. It is clear that Ry = K 
in the so graded ring R and that m is the height of the maximal prime 
ideal M generated by all homogeneous elements of positive. degrees in 
R: Furthermore, it is well-known (LR, 25.10) that R is locally Ma- 
canlay ‘and hence is of course also. H-Macaulay, er R is d- -proper for 
any positive integer d. To see this, let f= d: ` -dm and h=1l4, 

ft 


and set we 2,971, so that t,’ `, Um form a homogeneous system of para- 
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meters of degree fd for M; it is sufficient to show that an element of the 
form zz: Zum of degree dend +: + Tmdm with 1= mf is con- 
tained in the ideal R (u, ` `, um). Now, it is clear that the inequality 
rd, +++ +t rmdn = mfd implies the inequality ridi = fd for at least one 1, 
and hence the inequality 1; = fid for at least one +; and this implies that a,"! 
is contained in R(u,) and hence z is contained in R(w). Thus we have 
shown that the graded ring R satisfies the hypothesis of our main theorem. 
If we take for S a polynomial ring S=K[y;,---,y,] generated by n 
variables y,,- * `, 4, over K, graded by assigning each variable y; an arbitrary 
positive integer ej as its degree, and let e be any positive integer, then our 
main theorem shows that the Segre product A of order (d,e) of È. and. 8S is. 
a proper H- Macaulay ring. 

Finally, we give a couple of simple examples where the nase in our 
main theorem is not satisfied. Let R=Kl[r,2.,2;] be the homogeneous co-- 
ordinate ring of the plane curve defined by the equatoon 2? — tt: = 0. It. 
is clear that z,, x, form a distinct system of homogeneous parameters for the- 
maximal homogeneous ideal Mt in Æ. Since any relation between 2,, £a, Ña 
must be a multiple of the basic relation T? — 2’, 0, the element g” 
cannot be contained in #(2,22); this shows that Æ cannot be proper. By 
our main theorem, the Segre product A of R with any H-Macaulay ring of 
altitude > 1, say the polynomial ring 8 = K[4,, 42] of two variables, cannot. 
be H-Macaulay. In fact, the elements > 


Wi == 241, Wa == Loo, Wa = (T1 + L2) (Yı + Y2) 


form a system of homogeneous parameters for the maximal homogeneous. 
ideal 2 of A; but this system is not distinct, for the element z,°y,y, in A is. 
not in R(wı, w:) while the product 2574,y2° ws = T3? (Y1 + Ya) (yo: + Y1W2), 
is contained in R(w,,w,). The next example shows that even in case m = 1 
the condition in our main theorem need not be satisfied. Let R= K[2, 22] 
be the homogeneous coordinate ring of the irreducible 0-dimensional variety 
defined by the equation £4? — 2a,==0 over a prime field K of characteristic: 
342. It is clear that R is H-Macaulay with z, as a parameter for M, but. 
R is not proper since z, is not contained in R(x,). Therefore, by our main 
theorem, the Segre product A of R with 8 == K[y,, y2] is not H-Macaulay. 
We note that A is here the homogeneous coordinate ring K[41, 23, Zs, 24] of the- 
variety defined by the equation Za? — 22,7 == 0, 2,2 — 22.3 = 0, 2,2, — 42 = 03. 
the first two equations define four lines in the projective 3-space, while the- 
last equation excludes two of these four lines. 
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. MAXIMALE HOLOMORPHE UND MEROMORPHE 
ABBILDUNGEN, II. 


Von KARL STEm.* 


Im zweiten Teil dieser Arbeit! werden die Betrachtungen über maximale 
Abbildungen auf den Fall meromorpher Abbildungen ausgedehnt. 


83 und $4 haben vorbereitenden Charakter. In 83 werden die Begriffe 
stetige und holomorphe Korrespondenz sowie damit in Zusammenhang stehende 
Begriffsbildungen präzisiert und einige darauf bezügliche Aussagen bewiesen. 
84 handelt von allgemeinen Eigenschaften meromorpher Abbildungen, insbe- 
sondere werden Verknüpfungseigenschaften diskutiert. Der Begriff mero- 
morphe Abbildung wird hier im Sinne der Definition von R. Remmert [20a, 
22] benutzt. 


$5 enthält die Hauptergebnisse. Es werden zunächst vorbereitende 
Aussagen zum Begriff der Abhängigkeit meromorpher Abbildungen (der im 
Falle holomorpher Abbildungen die Abhängigkeit im weiteren Sinne ent- 
spricht) zusammengestellt. Nach Präzisierung des Begriffs der Maximalitat 
meromorpher Abbildungen, die als m-Macimalitat bezeichnet wird, der kom- 
plezen m-Basts zu einer gegebenen meromorphen Abbildung und verwandter 
Begriffe werden sodann Sätze über die Existenz meromorpher Abbildungen 
mit Maximalitätseigenschaften bewiesen. Es ergibt sich, dass—in Analogie 
zu Satz I im ersten Teil der Arbeit—die Existenz einer komplexen m-Basis 
zu einer meromorphen Abbildung f eines irreduziblen komplexen Raumes X 
stets dann gesichert ist, wenn es eine analytische Menge A in X gibt, derart, 
dass die holomorphe Korrespondenz f | A wenigstens eine irreduzible Kom- 
ponente besitzt, die eigentlich ist und den gleichen Rang wie f hat. Diese 
Aussage lässt sich verschärfen: Unter der gleichen Voraussetzung wird so- 
gleich die weitergehende Aussage (Satz III) gewonnen, dass auch in jeder 
“ f-Klasse ” % meromorpher Abbildungen stets eine “ %-maximale” Abbildung 
existiert (Definitionen in 5.3). Ein entsprechender Satz gilt für meromorphe 
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Abbildungskeime. Es folgt insbesondere, dass zu jeder meromorphen .Ab- 
bildung eines irreduziblen komplexen Raumes, die eine Unbestimmtheitsstelle 
maximaler Stufe besitzt, stets eine komplexe m-Basis existiert. 

In 86 werden Anwendungen gegeben: Mit Hilfe der Resultate von $5 
werden für Systeme meromorpher Abbildungen Aussagen gewonnen, die für 
den Fall meromorpher Funktionen: bekannten Sätzen über Beziehungen 
zwischen analytischer und algebraischer Abhängigkeit entsprechen. Durch 
Spezialisierung ergibt sich so ù. a. der Satz von W: Thimm [34,36] über 
die algebraische Abhängigkeit von menge Funktionen mit gemein- 
samen Unbestimmtheitsstellen. 


3. Koirenondenzen, Wir ei eine Reihe yon . kan. and 
Aussagen zusammen (vg. hierzu auch [5, 5a]).- 


8. 1. X und Y seien Mengen. Unter einer Korrespondenz von X nY 
wird eine Abbildung von X in die Potenzmenge (Y) von F verstanden; an 
Stelle von f: X>®B(Y) schreiben wir im folgenden stets f: X =s Y. 


J edem Element TEX ist vermöge f also e eine (leere oder nichtleere) Unter- 
menge f (£) von Y zugeordnet. ‘Im folgenden wird oft zwischen einele- 
mentigen Mengen und ihren Elementen nicht unterschieden ; dementsprechend 
werden Abbildungen von X in Y als spezielle Koria aufgefasst. 

Jede Korrespondenz fix tz ist durch eine Untermenge der Pro- 
duktmenge X X Y, ihren Graphen G[f], charakterisiert: Es: ist @[f] 
= ((z,y):seX,yef(z)}, und jede Untermenge G C X X Y bestimmt eine 
Korrespondenz f: X Sr Y mit @[f]-G@G. Man hat zwei Abbildungen 
n[f]: G[f]> X und f: G[f]-> Y, die durch die Projektionen von XXY 
auf X und Y induziert werden. [f] heisst die Projektion von er] in X, 
f die f durch Liftung nach G[f] zugeordnete Abbildung. 


Wir sagen, die Korrespondenz pid ee sei in der. Ken 
F: X — Y enthalten—in Zeichen fC wenn der ‘ Graph. ei: im 
Gräphen GEFI enthalten ist. `f heisst leer, wenn GEF leer. ist, l 


: Ist A eine Untermenge von X, so wird unter der Biag Y(4) 
vermöge der Korrespondenz f: Z pE Y die Menge aler-y € Y mit y€ f(x); 


zeA, verstanden. Die Beduini von f auf A ist eine’ 'Korzespondänz 
von, A.in FY, wir bezeichnen sie mit f | A: Ist A’ eine Untermenge von Y, 
in der die Bildmenge f(X) enthalten ist, so induziert f; indem jeweils f(z), 


ices 


MAXIMALE HOLOMORPHE UND MEROMORPHE ABBILDUNGEN, IL. ‘825 


2€-X, als-Untermenge von A’ genommen wird, eine oes a f: 
x Ta A’; die als die Beschränkung von f auf A’ Peneicnnet wird. - 


ae Zu jeder -Korrespondenz -f : X = Y gehört eine _ Umkehrkorrespondehz 
fr YE: Für yer ist ie): AR ‚die Menge der Elemente ze X mit 


gi € f (e). erklärt. Der Graph. ef] EIXZ geht‘ vermöge der durch 
(z, y) > (a, T) gegebenen Abbildung von XXY aut Y X X aus dem Graphen 
GEF] hervor, woraus (f*)7 =f folgt. 

Sind. f: x mae Efi Eee FY, Korrespondenzen, 50 ist das kar- 


‘tesise | Produkt fxfi: ZXZı =ar definiert ` als die durch 


(2,2) 3 f(a) x f(t) cCYxXyY, (ze X,rı € X,) gegebene Korrespondenz. 
(Ist f(z) ‚oder fı(zı) leer, so ist f(z) X fı(zı) die leere Untermenge von 
XXY): Es ist (fX fı) =f Xf. Man hat eine bijektive Abbildung 
r vonr G[f] X GAI CXA XY X ZX, XY, auf G[f Xfi] CX XXLKY XY, 
‘die von der durch Koordinatenpermutation bestimmten Abbildung ° 


T: XXYXX XY, >XXX,XYXY, 


induziert wird. Im Falle Xer, ‘wird unter der Verbindung Ohh): 
Lo EXE; von f und fı- die durch die Zuordnung z—>f(z) X fı(lz) 


ec y x Y, ı gegebene Korrespondenz verstanden... Bezeichnet Dr die Diagonale 
in XXX, 8x ihre Projektion auf X und n die identische Abbildung von 
Xı X Vi, so ist GE(f, f1)] = (8x X u) (GLF X fi) | Dz) : i 
„ Das Produkt gof von zwei Korrespondenzen, f: X—> Y,.g: Y => 
k 


ist definiert ‘als diejenige Korrespondenz von X in Z, die jedem ne x 
die Untermenge g(f(z))C Z mordnet. Für jede. Untermenge A CY ist 
dann -(gof)(A)—=g(f(4)). Der Graph G[gof] ist.das “Kompositum ” 
aljo Glg] von G[f] und @[g]: Ein Paar (z,2)C X XZ gehört ‚genau 
dann ‚zu G@[gof], wenn ein y€ F existiert, derart, dass (z,y) € G[f] und 
(4,2) € Gig] gilt. Ist D® die Teilmenge von X X Y X Y X Z = {(z, Y, Yı 2)} 
mit y =y, und bezeichnet 8 die Projektion von X X ¥ X Y X Z auf X X Z, so 
ist @[9°f] = B((@Lf] X G[g]) N D*). Es ist auch Gly of] — (f+, g) (F). 

Es gelten‘ die Regeln (gof)t= fog? und.ho(gof)=(hog)of. 
Im ‚allgemeinen ist f*of nicht die identische Abbildung von X und. fof? 
nicht: die identische’ Abbildung von Y (ist jedoch f eine’ Abbildung im 
gewöhnlichen Sinne und surjektiv, so ist fof* die Identität). . (Fo f)(A)D A 
gilt für jede. Teilmenge AC X ‘genau dann, wenn f(z) für kein ZEX leer 
‚oder — was ‚dasselbe besagt— wenn f+ surjektiv i ist. Stets ist f= ĵor[f]>, 
aber i.a. PA. Pe 
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3.2. Es seien jetzt X, Y usw. topologische Räume. Wir nennen eine 
Korrespondenz f: X —> K stetig, wenn die Projektion »[f]: @[f]>X eine 
x 


eigentliche Abbildung des Unterraums G[f] von XXY ist? Es ist klar, 
dass diese Definition für den Spezialfall von Abbildungen X — Y den üblichen 
Stetigkeitsbegriff liefert. Die zu einer stetigen Abbildung f: X->Y- ge- 
hörende Umkehrkorrespondenz f-t: Y ->x ist genau dann stetig, wenn f 


eigentlich ist. Denn f—=for[f]" ist, da »[f] ein Homöomorphismus ist, 
genau dann eigentlich, wenn Î es ist. 
Sei f: XZ—>TY stetig. Ist A ein Unterraum von X, weiter A’ ein 
= 


Unterraum von Y, derart, dass f(X) C A’ gilt, so sind auch die Reschrän- 
kungen f| A: 4—>Y und f: 24 von f auf A bezw. A’ stetig. 


Ist f:X —r stetig und Y Hausdorffsch, so ist der Graph @[f] 


‚abgeschlossen in X XY. Denn sei (2,y)€ XX Y ein Punkt, der nicht zu 
G[f] gehört. Dann gehört y nicht zu der kompakten Menge f(x) € Y, und 
es gibt eine zu f(x) punktfremde abgeschlossene Umgebung 7 von y. Die 
Urbildmenge f*(V) —-[f](f#*(V)) ist abgeschlossen in X und enthält z 
nicht; daher ist U:=-XY-——f*(V) eine offene Umgebung von v, und es ist 
U x Y CXX eine Umgebung von (z,y), die G[f] nicht trifft. 


PROPOSITION 3.2.1. Die Korrespondenzen f: X<—>Y, fy: 2, Y., 
k 


fr: X Ey Y,9:7 are seien stetig. Dann sind auch 
Ixh: XX M— oY XK, (Bf): £->¥ XP, el 


stetige Korrespondenzen. 


Beweis. 1) fX fı ist stetig: Die Abbildung 7’: G[f] x G] > GU X fa] 
(wir verwenden hier und im folgenden die in 3.1 eingeführten Bezeichnungen) 
ist ein Homéomorphismus. Es ist (x[f] X r[f1]) oe ""—r[fxX fı]; mit =[f] 
und «[fı] ist [f] X [fı], also auch r[f X fı] eigentlich. 


2) gof ist stetig: Sei M C @[gof] abgeschlossen. Bezeichnet 
P: (@[f] X @[g]) N D*— G[gof] 


2 Über eigentliche Abbildungen siehe [5a], § 10. Eine Abbildung X>Y ist genau 
dann eigentlich, wenn sie stetig und abgeschlossen ist und wenn die Urbilder der Punkte 
von Y quasi-kompakt sind (die Urbilder quasi-kompakter Mengen in Y sind dann eben- 
falla stets quasi-kompakt). Ist X Hausdorffsch und Y lokal kompakt, so ist eine 
stetige Abbildung X -> Y dann und nur dann eigentlich, wenn die Urbilder kompakter 
Mengen kompakt sind.— Vgl. zu den folgenden Ausführungen auch K. Wolffhardt [38]. 
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die durch, Beschränkung von $:XXYXxXYXxZ>XXZ bestimmte Ab- 
bildung, so ist auch (MM) =: M* C (G[f] X Glg]) N D* abgeschlossen. 
Sei M*, eine abgeschlossene Menge in G[f] x @[g], sodass 

M* N ((G[f] X GIg]) N D*) —M*, 
ferner y: G[f]-» G[f] die identische Abbildung; dann ist 


yXelgl: GF] X Gig] > Gif] XY . 

eine eigentliche Abbildung, also ist (4X «[g]) (M*.) —: W^, abgeschlossen 
2 me X Y. Es bezeichne weiter Dy die Diagonale von Y X Y, dann ist 
N (X X Dy) = (y X «[g]) (M*) = :M’ und daher M’ abgeschlossen in 
= y Dy, ‚Die durch die Projektion von X X Y X Y auf X X Y induzierte 
Abbildung A:XXDy>XxXT ist ein Homöomorphismus, also ist (ar) 
= : M” abgeschlossen in X X Y. Es ist dann auch »[g] (M”) abgeschlossen 
in X; andererseits ist [9] (M”) =r[gof](M). Somit ist »[gof] abge- 
schlossen. Für jeden Punkt ze X ist ferner f(x) C Y quasi-kompakt, also 
gilt gleiches für g(f(z)) —gof(a) C Z; da gof(2) ant algo f]*(e) C Gfgof] 
- homöomorph bezogen ist, ist mithin «[gof]-*(x) quasi-kompakt. [gof] 

ist demnach eigentlich, und es folgt die Behauptung. 

3) Die Abbildung x: Dr—>X ist ein Homöomorphismus; es ist (f, fi‘) 
= (f Xfi | Dx)o8x". Auf Grund von 1) and 2) ist (f,fi”) somit stetig. 
l 3.8. Eine Korrespondenz f: X —> Y heisse eigentlich, wenn f und die 

z 
Umkehrkorrespondenz f?: Y — X stetig sind? (f ist genau dann stetig, 
x 
wenn f: G[f]->Y eine eigentliche Abbildung ist). Sind die Räume X und 
Y lokal kompakt, so ist eine stetige Korrespondenz f: <—>Y dann und 
2 
nur dann eigentlich, wenn für jede kompakte Menge Ky C Y die Menge 
rn (Ky) in X kompakt ist. 
Proposition 3.3.1. Es seien f: iz. fa: X re g: eg 


eigentliche Korrespondenzen. Dann sind euch Ixfi Be gof eigentliche 
Korrespondenzen. l 


Beweis. Es ist (fX fı) =f Xfıt und (gof)*=ftog!; nach 
Proposition 3.2.1 sind mit f, P, fo fr, 9, g% auch Pael FXR’, gof, 
frog” stetig. 


. ® Vgl. [5a], p. 172, Ex, 10 f., wo der Begriff eigentlich (propre) für Korrespon- 
denzen weiter gefasst ist. Die oben benutzte Fassung führt für den Sonderfall von 
Abbildungen X -> Y zum üblichen Begriff der Eigentlichkeit zurück —Einige der obigen 
Aussagen ergeben sich auch aus den Exercises in [6a]. 
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Folgerung: Ist A eine abgeschlossene Menge in X, so ist mit f: er, Y 
auch die Beschränkung f | A von f auf den Unterraum A CX eigendlich., 


Denn die Injektion e: A> X ist eine eigentliche Abbildung, und es e 
f | Ass f Oe l 
PROPOSITION 8.3.2. Es seien f:X—>Y, fr: 2 — Y., g: Poz 
stetige K orrespondenzen. Die Räume X, Y. Ya, Z seien lokal kompakt. Dann 
gilt: 
(I) Ist f eigentlich, so auch (f,fi) und (fi’,f). 
(II) Ist gof eigentlich und g* surjektiv, so ist f we 
(III) Ist gof eigentlich und f surjektiv, so ist g eigentlich. * 


Beweis. Es seien Ky, Ky, Kz kompakte Mengen in Y bezw. Y, bezw. Z. 


(I) Nach Proposition 3.2.1 sind (f,fı) und (fx, f) stetig. Es ist 
weiter f*(Ky) kompakt, und f,/*(Ky,) ist abgeschlossen in X, daher ist 
ft(Ky) 0 f+ (Ky,) = (f, f) (Ky X Ky,) kompakt. Da jede kompakte 
Teilmenge von Y X Y, in einer kompakten Teilmenge der Form Ky X Ky, 
enthalten ist, folgt die Bigentlichkeit von (f, fi’ ye Entsprechend ergibt sich, 
dass (ff) eigentlich ist. ‘ 


(II) Die Menge f (Ky) =a[f] (#*(Ky)) ist abgeschlossen in x. 
Wegen der Surjektivität von g gilt Ky C g*(g(Ky)), also ist 


FHEr) C HC (9(Kx))) = (9 0f)" (g (Ey) ); 


mit g(Ky) ist aber (gef)(g(Kr)) kompakt, da gof als eigentlich voraus- 
gesetzt ist. f*(Ky) ist demnach kompakt und mithin f eigentlich. 


(III) Für jede Teilmenge Ar C Y gilt Ay C (fo f7) (Ar), da f sur- 
jektiv ist; also ist g*(Kz) C (For) (7> (Kz)) =f((gof)*(Kz)). Es ist 
g9"(Kz) slo] (9*(Kz)) in X abgeschlossen ; andererseits ist IgoN(Kz)) 
wegen der Eigentlichkeit von gof kompakt. Es folgt, dass g* (Ez) kompakt 
und somit g eigentlich ist.’ 


. 3.4. Im folgenden seien X, Y usw. komplexe Räume.* Eine stetige 
Korrespondenz f: X—>Y heisse holomorph, wenn der Graph @[f] eine 
x 


analytische Menge im komplexen Raum X X Y ist. 


t Unter einem komplenen Raum wird in dieser Arbeit stets ein komplexer Raum im 
Sinne von J. P. Serre [27] (redusierter komplemer Raum in der Terminologie von H. 


Grauert [10]) verstanden; alle vorkommenden komplexen Räume werden als nichtleer 
und cn vorausgesetzt, 
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Seif: XY —> Y nichtleer und holomorph, dann sind »[f]:@[f] >X und 
A 


f: @e[fJ>Y holomorphe Abbildungen. Unter dem Rang r(f) von f wird 
der Rang r(f) verstanden. Ist A eine nichtleere lokal-analytische Menge 
in X, weiter A’ eine lokal-analytische Menge in F, derart, dass f(X) C A’ 
gilt, so sind auch die Beschränkungen f | A: AT und f: i? A’ von 


f auf A bezw. A’ holomorph. Ist A” eine analytische Menge in Y, so ist 
f(A”) eine analytische Menge in X. Denn }*(A”) ist analytisch in G[f]; 
da [f] eigentlich ist, folgt nach R. Remmert [22] die Analytizität von 
[fl (f*(4”))=f*(4”) in Z. Ferner: Für jeden Punkt zeX ist f(x) 
eine (leere oder nichtleere) kompakte analytische Menge in Y, denn 
[f]*(z).C G[f] ist eine kompakte analytische Menge. Ist f auch eigent- 
lich, so ist f(X) =f(@[f]) eine r(f)-dimensionale analytische Menge in Y. 


Proposition 3.4.1. Die Korrespondenzen f: X —>Y, fı: ı —>Y,, 
k k 


fi’: X<—>Yı, 9: 7 —>Z seien holomorph. Dann sind auch 
k k 
Xfi: EXX, —>Y XY, (Lf): X—>Y XT, gof: X —>2 


holomorphe Korrespondenzen. 


Zum Beweis genügt es wegen Proposition 3.2.1 zu zeigen, dass die 
Graphen der Korrespondenzen f X fı, (f,fi) und gof analytische Mengen 
sind. Für G[fX fı] und G[(f,fx)] ist dies klar. Weiter ist (mit 
den Bezeichnungen von 3.1) G[gof]— 8((G[f] X G[g]) ND*). Es ist 
(G[f] x @[g]) N D* eine analytische Menge m XXYFxXYXZ. Die holo- 
morphe Abbildung £ | (GL[f] X GIg]) N D* = :B*: (GI X GLy]) N D* 
>XXZ ist ferner eigentlich. Denn ist K CX XZ kompakt, so ist zu- 
nächst B*!(K)C (G[f] X G[g]) N D* abgeschlossen; bezeichnet ox bezw. 
og die Projektion von X X Z auf X bezw. Z, so ist andererseits 8*!(K) 
— B°(K) N (G[f] X G[g]) N D* in der kompakten Menge 

af] *(ox(K))X f(oz(K))Xoz(K)C GU] X¥ XZ 
enthalten. Es folgt, dass 8*"(K)kompakt und somit ß* eigentlich ist; also 
-ist B*((G[f] X G[g]) O D* = G[go f] nach [22] eine in X X Z analytische 
Menge. 

Eine nichtleere holomorphe Korrespondenz f: X ae Y heisse irreduzibel, 
wenn ihr Graph @[f] eine irreduzible analytische Menge in X XY ist; 
anderenfalls heisst f reduzibel. Ist G[f] = y Q die Zerlegung von G[f] 


a 


10 
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in irreduzible Komponenten, so heissen die Korrespondenzen fi: X > Y 
mit G[fi] := 0% die irreduziblen Komponenten von f ; wir schreiben f == y fi 


Es ist klar, dass jede irreduzible Komponente fi von f wieder holomorph ist; 
ferner: Ist f eigentlich, so gilt dies auch für jedes I allgemeiner für jede 
in f enthaltene holomorphe Korrespondenz. 


Wir benötigen im folgenden oft 


PROPOSITION 8.4.2. Es seien fj: X—>Y (j—1,2) wreduzible holo- 
n i 


morphe Korrespondenzen; es extstiere eine offene Menge U in X, derart, 
dass die Beschränkungen f; | U: U—>Y nichtleer sind und übereinstimmen. 
k 


Dann ist fi = fa- “2 


Zum Beweis ist nur zu beachten, dass im Durchschnitt der Graphen 
G[fi] und G[f:], die irreduzible analytische Mengen in X X F sind, die in 
Gf] und G[f.] offene nichtleere Menge G[f; | u enthalten ist; daraus 
folgt G[f1] = @[f2] und fa = fa. 


4, Meromorphe Abbildungen. 


4.1. Sei f: X ar eine holomorphe Korrespondenz. Bin Punkt 


2 E X heisse ein Kanne Punkt inbezug auf f, wenn es eine Umgebung 
U von 2, gibt, derart, dass für jeden Punkt ze U die Menge f(x) einpunktig, 
dass also f | U: nr Y eine Abbildung im gewöhnlichen Sinne ist. Eine 


nichtleere Menge in Y, die aus lauter ausgezeichneten Punkten inbezug auf f 

besteht, nennen wir ausgezeichnet inbezug auf f. Ist U eine offene Menge 

dieser Art, so ist die holomorphe Korrespondenz »[f| U]: U —> G[f|U] eine 
k 


stetige Abbildung von U in G[f| U], und diese Abbildung ist in jedem 
gewöhnlichen Punkte von U holomorph. Demnach hat auch f in jedem 
gewöhnlichen Punkt von U den Charakter einer holomorphen Abbildung. 
Da die nichtgewöhnlichen Punkte des komplexen Raumes U eine in U 
nirgendsdichte analytische Menge bilden, folgt, dass es in U eine dichte 
offene Menge U’ gibt, sodass f | U’ eine holomorphe Abbildung ist. 

Eine nichtleere holomorphe Korrespondenz f: X Er Y heisst eine mero- 


morphe Abbildung von X in Y, wenn folgendes zutrifft: Ist der komplexe 
Raum X irreduzibel, so gilt l 


1) f ist irreduzibel, 
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2) es gibt in X wenigstens einen ausgezeichneten Punkt inbezug auf f; 
ist X reduzibel und X == J X®, ic I, die Zerlegung von X in irreduzible 
4 


Komponenten, so gibt es holomorphe Korrespondenzen fi: X——> Y, derart, 
z 
dass f == |] f; gilt und dass jeweils f; |X eine meromorphe Abbildung und 
7 


fı] X—X leer ist’ Ist f eine meromorphe Abbildung von X in Y, so 
schreiben wir auch f: <—>Y. Besitzt ein Punkt z€ X eine offene Umge- 


bung U, derart, dass f | U eine holomorphe Abbildung ist, so nennen wir g 
nichtsingulär inbezug auf die meromorphe Abbildung f; anderenfalls heisst x 
eine ausserwesentliche Singularität von f. Jeder inbezug auf f: X—>F nicht- 


singuläfe Punkt ist ausgezeichnet inbezug auf die holomorphe Korrespondenz 

f; umgekehrt gibt es in jeder inbezug auf die holomorphe Korrespondenz f 

ausgezeichneten offenen Menge eine offene dichte Untermenge, deren Punkte 

nichtsingulär inbezug auf die meromorphe Abbildung f sind. Die Menge der 

ausserwesentlichen Singularitäten von f: X—>Y werde mit S(f) bezeichnet. 
a 


Zu 8(f) gehören insbesondere diejenigen Punkte ze X, für welche f(x) nicht 
einpunktig ist; solche Punkte heissen Unbestimmtheitsstellen von f. 
Meromorphe Abbildungen hängen eng mit eigentlichen Modifikationen 
komplexer Räume zusammen. Wir erinnern zunächst an diesen Begriff (vgl. 
hierzu [3, 11, 16, 17, 81, 82]). Sei r:’X—X eine eigentliche holomorphe 
Abbildung; es existiere eine offene Menge U in X mit folgenden, Eigen- 
schaften: 1) U hat mit jeder irreduziblen Komponente von X gemeinsame 
Punkte und r!(U) hat mit jeder irreduziblen Komponente von ’X gemein- 
same Punkte, 2) die Korrespondenz T? |U: U>X ist eine holomorphe 


Abbildung. Dann heisst r eine eigentliche odiibationsab dung und das 
Tripel (X,r,X) eine eigentliche Modifikation von X. Ein Punkt von X 
heisst singulär inbezug auf (’X,r,X), wenn er keine offene Umgebung V 
besitzt, derart, dass r? | V: v—’z eine holomorphe Abbildung ist. 


Eine eigentliche Modifikationsabbildung +:’X X ist insbesondere sur- 
jektiv. Ist ’X =: AX, +€ I, die Zerlegung von ’X in irreduzible Kompo- 


nenten, 80 Sen dieser Zerlegung die von X in irreduzible Komponenten: 

Es ist jeweils +(’X) — : X¥ eine irreduzible Komponente von X, für 14] 

sind X® und XW verschieden, und es gilt Z=|JX®. Die durch Be- 
i 


° Der hier benutzte Begriff der meromorphen Abbildung eines komplexen Raumes 
stammt von R. Remmert [202,21]. Ein anderer Begriff der meromorphen Abbildung 
wurde von W. Stoll [31] (vgl. auch [1,33] eingeführt, Über meromorphe Abbildungen 
und ihre Grundeigenschaften siehe ferner [16, 17, 18a]. 
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schränkung von r bestimmten Abbildungen r: X®—>XW® sind ebenfalls 
eigentliche Modifikationsabbildungen, und es ist jeweils r(7) = dim’XW 
= dim X, 

Eine holomorphe Korrespondenz f: X i Y ist nun offenbar genau 


denn eine meromorphe Abbildung, wenn die holomorphe Abbildung If]: 
@[f]>X eine eigentliche Modifikationsabbildung ist. Hat [f] diese Eigen- 
schaft, so ist jeder inbezug auf die eigentliche Modifikation (G[f], «[f], X) 
singuläre Punkt von X eine ausserwesentlich Singularität der meromorphen 
Abbildung f und umgekehrt. —Wir notieren ferner, dass die zu einer eigent- 
lichen Modifikationsabbildung +: X — X gehörige Umkehrkorrespondenz rt: 
X m? ’X stets eine meromorphe Abbildung ist. 


Es gilt: 
PROPOSITION 4.1.1. Die Menge der singulären Punkte inbezug auf 


eine eigentliche Modifikation (’X,7,X) ist eine nirgendsdichte analytische 
Menge in X. 


Hieraus folgt unmittelbar 


PROPOSITION 4.1.2. Die Menge S(f) der ausserwesentlichen Singu- 


laritäten einer meromorphen Abbildung f: X ne ist eine nirgendsdichte 
analytische Menge in X. 


Wir stützen den Beweis von Proposition 4.1.1 auf verschiedene Hilfs- 
aussagen.® 
Sei ¢: XY eine holomorphe Abbildung. & heisst im Punkt ze X 
regulär, wenn der durch & induzierte Homomorphismus des Ringes der in 
== (x) € Y holomorphen Funktionskeime in den Ring der in xe X holo- 
morphen Funktionskeime surjektiv ist. Es gilt 


(I) Die Menge der Punkte, in denen eine holomorphe Abbildung 
p: XY nicht regulär ist, ist eine analytische Menge in X. 


(II) Die holomorphe Abbildung p: X>Y ist im Punkte ze X genau 
dann regulär, wenn es eine offene Umgebung V =F (z) und eine lokal- 
analytische Menge A* CY gibt, derart, dass (V) =A* und die durch 
Beschränkung von p bestimmte Abbildung V— A* biholomorph ist. 


Da beide Aussagen lokaler Natur sind, genügt es zu ihrem Beweis, die 


° Auf die Möglichkeit, den Beweis wie im folgenden zu führen, wurde ich von H. 
Grauert hingewiesen. Vgl. auch [10a], $1.—Die unten benutzte Aussage (II) ergibt 


sich unmittelbar auch aus der Aussage (1) von A. Andreotti in [10a], $1. Vgl. ferner 
[18b]. 
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Betrachtung auf je eine Umgebung eines Punktes von X und seines Bild- 
punktes in Y zu beschränken. Es darf daher angenommen werden, dass X 
als eine analytische Menge in einem Gebiet D, des C*(&,- - -, £n) = C* (£) 
und Y als eine analytische Menge in einem Gebiet D, des C*(m,: - -,m) 
== C!({n) gegeben ist. Ist dann z,€ X irgendein Punkt, so lässt sich ein 
Gebiet D C Dy, das z, enthält, mit der folgenden Eigenschaft wählen: Es 
gibt eine holomorphe Abbildung F: D>D,, derart, dass F(IDNX)CY ist, 
und dass die durch Beschränkung von F bestimmte Abbildung DN X~Y 
mit ¢| D N X übereinstimmt. —F wird durch 


E>n—(m,° ° +m) = (falé) o o’ LCD) 


beschrieben, wo éE D, „E€ D, ist und f,(é),---,fi(é) in D holomorphe 
Funktionen sind. Es sei noch A: =D N X und F: =F | A: A— D, gesetzt. 

Wir benutzen weiter die folgende Terminologie: Ist Z ein komplexer 
Raum, Z’ eine analytische Menge in Z, so sei O(Z) die Strukturgarbe von Z 
und $(7) C O(Z) die Idealgarbe von Z’. Für einen Punkt z€ Z wird der 
Halm über z einer Garbe über Z durch einen unteren Index z gekennzeichnet. 
Das maximale Ideal im Ringe ©,(Z) werde mit m,(Z) bezeichnet; für z€ 2’ 
sei ferner pe[Z’]: m,(Z) > m,(Z’) der natürliche Homomorphismus. 

Ist nun a irgendein Punkt von A und b:=d(a)=F’(aJ)EYCD, 
so hat man durch ¢, F, F’ induzierte Homomorphismen 


#62: Oo (F)>Ds(A), *Fa: Or(D1) > Da(D), 
"Pr: (Di) >D,(A) sowie ra: m (F)>m, (A), 
va: m(D)>m(D) und Y,:m(D)>m (A). 


*6, ist genau dann surjektiv, wenn *F’, es ist, d.h. & ist im Punkte a 
genau dann regulär, wenn dies für W” in a zutrifft. Diese Eigenschaft hat F” 
andererseits genau dann, wenn v”’, surjektiv ist, und dies tritt genau dann 
ein, wenn m(D) = (A) +v,(m,(D:)) gilt, denn man hat vs = pal A] 0 va 
wo al A] surjektiv und Kern (u[A]) = %e(A) ist. 

Es werde jetzt eine offene Umgebung U(a) C D und ein System von 
in U(a) holomorphen Funktionen g,,' ' ',9s so gewählt, dass für jeden 
Punkt vo (w,' ,Wu)EUl(a)NA das System der von den 9,°''',9s 
repräsentierten Funktionskeime giu,’ ' ‘39ean das Ideal (4) C O,(D) 
erzeugt; eine solche Wahl ist wegen der Kohärenz der Garbe $(A) C O(D) 
möglich. Die Elemente des Ringes „(mem (D1)) CDOs(D) werden reprä- 
sentiert durch die in wu verschwindenden konvergenten Potenzreihen in ‘den 
Funktionen f,(é):==;(€) —Fılu). Es ist nun 


mu(D) = Su(A) + r'u (mec (D1)) 
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~——also F’ in u regulir—genau- dann, wenn die Funktionalmatrix M% (¢) des 
Systems der Funktionen. ga (é): ý *,ga(€), f™,(€),° j *, fr (€) im Punkte 
=u den Rang n hat. Denn ist der Rang von M% (£) gleich n, so lassen 
sich gewisse der 9.(£), f™,(é) als lokale Koordinaten in u einführen; jede 
in u holomorphe Funktion lässt sich dort also in eine Potenzreihe in den 
go(), fh (é) entwickeln, woraus unmittelbar 


mu (D) = Bu(A) + vami (D:)) 


folgt. Ist andererseits der Rang von M(E) kleiner als n, so lassen sich sicher 
nicht alle lokalen Koordinaten £#);;=mé;—u, (j—=1,:--,n) in der Gestalt 
é); mm ay (€) + B;(E) darstellen, wo die durch die a, bezw. 8, repräsentierten 
Keime a; bezw. Bu zu (A) bezw. Yulmem(Dı)) gehören; "also ist 
mu(D) AA) + vVulttec (Di)).— Für jeden Punkt £E U(a) stimmt der 
Rang von M(E) mit dem Rang der Funktionalmatrix M(£) des Systems 
ga (é); : *,gal€), ERDE i filé) überein. Die Punkte u€ U (a) NÁ, in 
denen F” nicht regulär ist, sind demnach dadurch charakterisiert, dass in 
ihnen der Rang der Matrix M(£) kleiner als n ist; diese Punkte bilden 
mithin eine analytische Menge in U (a) NA. Hieraus folgt die Aussage (I). 
Es bezeichne weiter H: U(a).—> CH (om Com) =C (E, y) 
die durch die Zuordnung £> (los om) = (Pa (E) * +, 92(€), 
(dsl) (EE U(a)) bestimmte holomorphe Abbildung. Ist F” in 
a regulär, so ergibt sich aus der obigen Betrachtung, dass eine offene Um- 
gebung U,(a) C U(a) mit der folgenden Eigenschaft existiert: H(U,(«)) 
ist eine singularitätenfreie analytische Menge in einer offenen Umgebung von 
H(a) im C**!(£,n), derart, dass die durch Beschränkung von H bestimmte 
Abbildung ’H: U,(a)—>H(U,(a)) biholomorph ist. Die Menge U,(a) NA 
wird daher vermöge ’H bijektiv auf eine analytische Untermenge ’A vor 
H(U,(a)) abgebildet. ’A liegt in dem durchs —=&,==0 gegebenen 
Unterraum L? des C**#({,y). Vermöge der durch (£,7) > gegebenen Pro- 
jektion C**#(¢,7) —> C! (q) wird ’A bijektiv auf eine lokal-analytische Menge 
A* in D, bezogen; es ist dann F’(U,(a2)MA)—A®*, und die durch Be- 
schränkung von F’ bestimmte Abbildung F’*: U,(a) N A— A* ist biholo- 
morph.—Gibt es umgekehrt zu F” ein U,(a) und ein A* mit dieser Eigen- 
schaft, so ist klar, dass F” in a regulär ist. Somit folgt die Aussage (II). 
Wir benötigen weiter 


(III) Se p: X—>Y eine. eigentliche holomorphe Abadia, ferner 
N die Menge derjenigen Punkte x von X, für welche die Faser $*($(z)) 
mehr als einen Punkt enthält. Dann ist die abgeschlossene Hülle N von N 
in X: eine analytische Menge. 
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“" Wir beweisen dies mittels vollständiger Induktion nach der Dimension 
des: komplexen Raumes X.’—Die ‚Behauptung ist richtig für dim X —0. 
Angenommen, sie sei bewiesen für Dimensionen bis n—1 (n>0). Sei jetzt 
dim X =n. Ist Z= z9 (t€ I) die Zerlegung von X in irreduzible 


Komponenten, so werde mit ®X jeweils die ‘Vereinigung der von X(# ver- 
schiedenen irreduziblen Komponenten von X bezeichnet. Ein X ist jeden- 
falls dann in N enthalten, wenn $(X“) C $(X) oder wenn r(¢ |X) 
<dimX®, Sei (ZH) F (HX) und r(¢| XO) —dim XO, Dann ist 
p(X) =: XW* eine irreduzible analytische Menge in Y mit dim X(* 
= dim 2%, Es sei &: X —> XO* die durch Beschränkung von ¢ bestimmte 
eigentliche holomorphe Abbildung, ferner K, die Menge der Punkte von XW, 
in denen qy nicht regulär ist. Nach (I) ist K; eine analytische Menge in X%, 
und diese ist wegen r(&) =dim X von ZW verschieden. Bezeichnet .L,* 
die Menge der nichtgewöhnlichen Punkte von X9*, und wird 


AL,* : = DU (Kı), My: = dy? (H*) 


gesetzt, so sind dann auch die analytischen Mengen M,*, M; von X* bezw. 
X% verschieden. Sei &: X“ —M,;— XW* — M,* die durch Beschränkung 
von ¢4 bestimmte eigentliche surjektive und wegen (II) lokal biholomorphe 
Abbildung, weiter b; die Blätterzahl der analytischen Überlagerung 


(XO— My p’, ZU — Mi). 


Ist by > 1, so gehört sicher XY zu Ñ. Ist aber 441, so ist dy’ eine biholo- 
morphe Abbildung, insbesondere ist für ze X“) —M, die Faser 


Hl (2) ) — er ($4 (2) ) 


stets einpunktig. Die in X analytische Menge (¢|X)+*($(X)) ist 
von X verschieden, daher ist auch Xy\:—M,U ($ | X)+(¢(@X)) eine 
von X® verschiedene be Menge in X, Offenbar ist jetzt X N Ñ 
in X, enthalten. 

Es hat sich ergeben, dass für beliebiges +€ I entweder X® N W— XW 
ist oder dass es in X eine von X verschiedene analytische Menge X, 
gibt, derart, dass XN in X, enthalten ist. Sei .X die Vereinigung 
der XO mit ZO N Ñ = X® und X, die Vereinigung der in den übrigen X9 
enthaltenen X. Da .X und X, abgeschlossene komplexe Unterräume von 
X sind, ‘sind die holomorphen Abbildungen #|.X und ¢|X, pele 


1 Wie, früher festgelegt, werden alle vorkommenden EEE Räume als endlich- 
dimensional vorausgesetzt. Für beliebige komplexe Räume bleibt die Aussage offenbar 
gültig. 


836 KARL STEIN. 


ferner ist dim X, < dim ¥ ==n. Bezeichnet N, die Menge derjenigen Punkte 
To von Xo, für welche die Faser (# | Xo)*((¢| Xo) (#o)) nicht einpunktig 
ist, so ist nach Induktionsvoraussetzung die abgeschlossene Hülle N, von No 
eine analytische Menge in Xo. Es ist nun 


F= (OX N Ñ) U (Zo N N) = oF U Ño U ($ | Xo) (G(X) ; 


da X, N, und (# | Xo) > ($ (0X) ) analytische Mengen in X sind, ist also auch 
N eine analytische Menge in X. 

Nun zum Beweise von Proposition 4.1.1.—Sei ’N, die Menge der Punkte 
von ’X, in denen r: ’X—X nicht regulär ist, ferner ‘N, die Menge derjenigen 
Punkte ’re’X, für welche die Faser r"!(r(’z)) nicht einpunktig ist. ’N, 
und die abgeschlossene Hülle ‘Ny von ’N, sind nach (I) bezw. (III) 
"analytische Mengen in ’X; also ist ‘N:=—’N,U/’N, analytisch in “XY, und 
‘N ist in ’X nirgendsdicht, da + eine eigentliche Modifikationsabbildung ist. 
Es ist dann auch V:==7(’N) eine in X nirgendsdichte analytische Menge. 
Jeder Punkt ze N ist singulärer Punkt inbezug auf die eigentliche Modifi- 
kation ((X,7,X): Wäre x gewöhnlicher Punkt inbezug auf (’X,r,X), so 
gäbe es eine offene Umgebung V =F (z), sodass r*| V; v_—’z eine 


holomorphe Abbildung ist; dann aber könnte kein Punkt von r!(V) zu ’N, 
oder ‘N, gehören. Ist andererseits z, ein Punkt von X—N, so gibt es 
genau einen Punkt "mE ’X mit (u) =. Da me’X—N, ist rin’ 
regulär. Nach (II) gibt es mithin eine offene Umgebung ’V = ’V(’x,) und 
eine lokal-analytische Menge A C X, derart, dass +(/V) =A und die durch 
Beschränkung von r bestimmte Abbildung ’r:’V-—»>A biholomorph ist. A 
muss eine Umgebung von z, in X sein. Denn sonst gäbe es eine Folge von 
Punkten ze X—A (v=1,2,: : +), die gegen x, konvergierte; es liesse sich 


dann wegen der Kompaktheit der Menge 7 (zo) U U tT (ay) in U T (ay) 
yal v1 


eine Punktfolge ’z, wählen, die gegen einen Punkt von r"'(z,) konvergierte; 
da aber r(2,) nur aus ’z, besteht, würden fast alle der ’z, in ’V, also 
unendlich viele der z, in A liegen, im Widerspruch zur Wahl der z,. Es folgt, 
dass es eine in A enthaltene offene Umgebung 9%,=Y,(z,) gibt, sodass 
ri] Vo: Me eine holomorphe Abbildung ist; demnach ist z, eine 
gewöhnlicher Punkt inbezug auf die eigentliche Modifikation (’X,r,X). Die 
Menge der singulären Punkte inbezug auf (’X,r,X) stimmt also mit der 
analytischen Menge N überein. Damit ist Proposition 4.1.1 bewiesen, und 
es ergibt sich auch die Richtigkeit von Proposition 4.1.2. 

Das Bild eines Punktes ze X unter einer meromorphen Abbildung 
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f: X—>Y ist stets eine nichtleere kompakte analytische Menge in Y. 


Unter besonderen Voraussetzungen lassen sich über die Bildmengen f(z) 
genauere Aussagen machen. 


Proposition 4.1.3. Sei f: X—>Y eine meromorphe Abbildung. Ist 


X im Punkte x irreduzibel, so ist f(x) zusammenhängend. Ist X eine 
normaler komplexer Raum, so ist ze X genau dann eine ausserwesentliche 
Singularitat von f, wenn dimf(z) >0 ist. 


` Beweis. f(x) C Y ist genau dann zusammenhängend, wenn [f]*(z) 
C @[f] zusammenhängend ist. Es sei L eine zusammenhängende Kompo- 
nente ven r[f]= (s). Dann lassen sich je eine offene zusammenhängende 
Umgebung V von z und V* von L so wählen, dass x[f](V*) —V gilt, dass 
die durch Beschränkung von »[f] bestimmte Abbildung »*: V*— V eigent- 
lich ist (vgl. [29], Hilfssatz 3)® und dass Y*Na[f]"(e)—Z ist. Ist 
nun X in g irreduzibel, so kann V ausserdem als irreduzibel angenommen 
werden (nötigenfalls sind V and V* noch geeignet zu verkleinern). Es ist 
r(x*) = dim V’*—dimX. ~*(V*) ist demnach eine analytische Menge von 
maximaler Dimension in V, wegen der Irreduzibilität von V ist also x*(V*) 
= V. Bezeichnet U die Menge der inbezug auf f ausgezeichneten Punkte 
in F, so folgt, dass w[f]*(U) —n*"(U) C V* gilt. Andererseits liegt 
x[f] > (U) sicher in der offenen Menge x[f]*(¥V) dicht, mithin ist wegen 
Y* Cx[f]*(V) notwendig Vr—r[f](P). Daher ist auch LZ=r[f]*(z), 
d.h. w[f]*() ist zusammenhängend. 

Ist X normal (also insbesondere lokal-irreduzibel), so sei EX ein 
Punkt, derart, dass dim f(z) —0 ist. f(z,) ist dann ein Punkt—denn f(z») 
ist, wie soeben bewiesen, zusammenhängend—, also ist auch [f]’(z.) ein 
Punkt ©,*€ @[f]. Der lokale Rang von »[f] in z, ist maximal (d.h. gleich 
dim G[f] = dim X); gleiches gilt dann für alle Punkte einer offenen Um- 
gebung U,* von 2%. Es folgt, dass Uo: -=[f](Uo*) ebenfalls offen, also 
eine Umgebung von z, ist. Bezeichnet ro: U,*— U, die durch Beschränkung 
von [f] bestimmte Abbildung, so ist für z’ € U, stets mot (z) eine nichtleere 
diskrete Menge, und diese muss einpunktig sein, da sonst =[f]-!(2’) nicht 
zusammenhängend wäre und dann gleiches für f(x’) gilte. Demnach ist m, 


£ Der in [29], p. 77, gegebene Beweis des Hilfssatzes 3 hat eine Lücke: Es ist nicht 
ohne weiteres ersichtlich, dass es eine Umgebung V der Zusammenhangskomponente N 
von F(F(p)) mit der dort beschriebenen Eigenschaft gibt. Dies lässt sich jedoch 
zeigen. Wird noch vorausgesetzt, dass F’(F(p)) —N in F’(F(p)) abgeschlossen ist, 
so ist die Existenz eines V evident. Diese zusätzliche Voraussetzung ist bei allen 
Anwendungen des Hilfssatzes 3 in [29] erfüllt. und auch im obigen Falle gegeben. 


838 KARL STEIN. 


bijektiv, also wegen der Normalität von X sogar biholomorph. Für r^c Uy 
gilt [f] (2) =r (z), daher ist f(2’) —fomo*(a’), woraus sich ergibt, 
dass f| Us: Uo—> Y eine holomorphe Abbildung und infolgedessen s, ein 
nichtsingulärer Punkt inbezug auf f ist. Für jede ausserwesentliche Singu- 
larität s€ X muss mithin dim f(z) >0 sein. Dass umgekehrt jeder Punkt 
zeX, für welchen dimf(z) >0 gilt, eine ausserwesentliche Singularität 
von f ist, ist klar. 


4.2. Wir beschränken die Betrachtung meromorpher N von 
nun an der Einfachheit halber auf den Fall irreduzibler komplexer Urbild- 
räume. Die im folgenden in diesem und den weiteren Paragraphen erörterten 
und mit, meromorphen Abbildungen zusammenhängenden Begriffsbildungen 
und Aussagen nebst Beweisen lassen sich jedoch ohne Schwierigkeit mutatis 
mutandis auf den Fall reduzibler Urbildräume übertragen. 


PROPOSITION 4.2.1. Es sein f: X—— X und fı: X,—> Y, mero- 
m m i 
morphe Abbildungen. Dann ist auch fX fı: XX Xi—> YX Yi. eine 
m 
meromorphe Abbildung. 


Beweis. Nach Proposition 3.4.1 ist fX fı eine holomorphe Korre- 
spondenz. Die Irreduzibilität des Graphen G[f X fı] ergibt sich daraus, dass 
mit G[f] und @[fı] auch G[f] x @[fi] ein irreduzibler komplexer Raum ist. 
Ist ferner z€ X ein ausgezeichneter Punkt inbezug auf f, z,€ X, ein ausge- 
zeichneter Punkt inbezug auf f, so ist (z, t1) € X X X, ein ausgezeichneter 
Punkt inbezug auf f X fı. 

Die Verbindung zweier meromorpher Abbildungen f: 2X Brg Y und 


fi: <—>Y, ist im allgemeinen nicht wieder eine meromorphe Abbildung, 
dis de Beispiele zeigen—der Graph von (f, fr): X—>YxFY, 
nicht notwendig irreduzibel sein muss. Ist weiter g: Y—>Z wae mero- 
morphe Abbildung, so braucht auch das Produkt gof: X 5 Z keine mero- 


morphe Abbildung zu sein. Es lassen sich aber eine Verbindung zweiter Art 
und unter einer besonderen Voraussetzung ein Produkt zweiter Art für mero- 
morphe Abbildungen so einführen, dass diese Verknüpfungen wieder mero- 
morphe Abbildungen ergeben. —Wir benötigen 


Proposition 4.2.2. Set f: X—>Y eine holomorphe Korrespöndeng 
k 


des irreduziblen komplexen Raumes X in den komplexen Raum Y. Es 
ezistiere in X ein ausgezeichneter Punkt inbezug auf F. Dann gibt es genau 
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eine meromorphe Abbildung f: X—— Y, die in F enthalten ist. Es gibt 
nn 


ferner eine von X verschiedene analytische Menge M in X, derart, dass 
F| X—H eine holomorphe Abbildung und daher F|X— M=F|X—M 

Beweis. Ist z,€ X ein ausgezeichneter Punkt inbezug auf f’, so sei f 
diejenige irreduzible Komponente von f, deren Graph G[f] den Punkt 
x|] (xo) enthält. To ist auch ausgezeichneter Punkt inbezug auf f, daher 
ist f eine meromorphe Abbildung. Ist fọ eine weitere in f enthaltene mero- 
morphe Abbildung, so ist jeder inbsezug auf f ausgezeichnete Punkt auch 
ausgezeichneter Punkt inbezug auf fy. In einer Umgebung von 2, stimmt 
daher f**mit fe und mit f überein; nach Proposition 3.4.2 ist dann fo =f: 
Hat f ausser f noch weitere irreduzible Komponenten f, je J, 80 sei 
Pe oe es ist dann x[f’](G[f’]) =:N eine analytische Menge in X, 
und diese enthält z, nicht, ist also von X verschieden. Ist andererseits 
F=f, so sei N:—=®. Es hat dann M:—=NUS(f) die oben angegebene 
Eigenschaft. 

Sind nun fı: X —> Y., fe: X—— Y, meromorphe Abbildungen, so ist 

m m 

das in X dichte Gebiet U : = X — (S (f1) U 8 (f2) ) ausgezeichnet inbezug auf 
die holomorphe Korrespondenz (fuf2): X EH Yı X Yı. Die nach Proposi- 
tion 4.2.2 in (fı fz) enthaltene eindeutig bestimmte meromorphe Abbildung 
sei als Verbindung zweiter Art oder meromorphe Verbindung von fı 
und f, bezeichnet; wir kennzeichnen sie durch die Schreibweise {f1 f2}: 
X— Y,X Y3. 

m 


Für drei meromorphe Abbildungen fi: X—> Y, (i—1,2,3) sind die 
m 


meromorphen Verbindungen {{f1, fa}, fa} und {f1, {fz fa}} definiert und, wie 
sich mit Benutzung von Proposition 3.4.2 ergibt, gleich; es darf also 


{fa fas fa): = fo fa} fo} = {fo (fo, fs}} geschrieben werden. Allgemein ist 
dann auch für ? meromorphe Abbildung fa: < —Nh (A=1,-: - -,1;122) 


die meromorphe Verbindung {fu < -,fi}: X P YX- -X Y, definiert. 
Es seien weiter meromorphe Abbildungen 3 X iad Y und g: Y = 


gegeben. Falls es in X einen inbezug auf die Hölsmötph T E 
gof: X——>Z ausgezeichneten Punkt gibt, so existiert nach Proposition 
k 


4.2.2 genau eine in gof enthaltene meromorphe Abbildung; wir nennen dann 
diese meromorphe Abbildung das Produkt zweiter. Art oder das meromorphe 
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Produkt von f und g und schreiben g Af: X =e ° Wenn im folgenden 


die Sprechweise benutzt wird, dass g Af definiert sei, s0 ist stets gemeint, 
dass gof die obige Voraussetzung erfüllt. 

Das meromorphe Produkt 9 A f ist insbesondere dann definiert, wenn die 
Bildmenge f(X) nicht in der Menge $(g) der ausserwesentlichen Singu- 
laritäten von g enthalten ist. Denn trifft dies zu, so ist die Menge U: 
= X — (S(f) Uf*#(S(g))) nichtleer, und für jeden Punkt zE U ist: die 
Menge gof(z) einpunktig; also ist U eine inbezug auf gof ausgezeichnete ` 
Menge in X. Ist f surjektiv, so ist f(X) nicht in $(g) enthalten, also ist 
dann g Af immer definiert. 

In besonderen Fällen stimmen gof und g A f überein. Z. B. gilt: 
Ist f:X Ze eine meromorphe und g: Y—>Z eine holomorphe Ab- 


bildung, 80 ie gof=g Af. Denn der Graph G[gof] lässt sich aus dem 
Graphen G[gof] C G[f] XZ der holomorphen Abbildung gef: elfl>Z 
vermöge der eigentlichen holomorphen Abbildung 


elf] Xz: Gf] XZ>XXZ (ız: Z>Z die identische Abbildung) 


erhalten, mit @[gof] ist dann auch G[gof] — (x[f] X ız) (@[gof]) irre- 
duzibel.—Ist f: X—> Y holomorph und g: Y —— Z meromorph, so gilt, falls 
"m 
g Af definiert ist, im allgemeinen gofy4g Af. Z.B. ist, wenn g Unbe- 
stimmtheitsstellen besitzt, stets g A r[g] = ĝ in gox[g] echt enthalten. | 
Ist A eine nichtleere irreduzible lokal-analytische Menge in X, «: A>X 
die Injektion und f: X—>Y so beschaffen, dass f A e: A—— Y definiert 
m ; m 
ist, so nennen wir f Ae die meromorphe Beschränkung von f auf A und 
schreiben f I A:=f Ac Es ist stets r(f|A)<r(f), wie sich mittels Pro- 
ke 
position 1. 2. 1 ergibt. 
Im allgemeinen ist f l A von der holomorphen Korrespondenz fl A=f oe 
A a Y verschieden, da der Graph G[f | A] nicht irreduzibel zu sein braucht. 
Ein "Fall, in dem aber fi A mit f | A zusammenfällt, liegt vor, wenn A ein 
Gebiet in X ist: Es ist dee — 8 (f) ein in A dichtes irreduzibles Gebiet; _ 
dann ist auch »[f]""(4,) ein in r[f]= (4) dichtes irreduzibles Gebiet, worans 
sich die Irreduzibilität von G[f|A] und damit die Uberesuramung vou 
fla und f| 4 ergibt. 


Dass für eine lokal-analytische Menge A’ in Y, in der die Bildungs 


° Vgl. hierzu und zu folgenden Ausführungen auch [16] und [33]. 
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f(X) enthalten ist, die Beschränkung von f auf A’ stets wieder eine mero- 
morphe Abbildung ist, ist klar. 
Für drei meromorphe Abbildungen f: t—>?, g: ¥—>4, h: De z’ 


kann A A (g Af) definiert sein, ohne dass (h A g) Afes iat und E E 
Die meromorphen Abbildungen sind aber dann beide definiert und gleich, 
wenn f und g surjektiv sind. Denn in diesem Falle sind zunächst g A f und 
(h Ag) Af definiert; es ist ferner 


U:=X — (S(f) UfF*(S(g)) U (gf) *(8(A))) 
eine inbezug auf hogof: X—> 7 ausgezeichnete offene Menge in X. Kür 
k 
ze U gilt dann 


ho (g AF) (z) Chogof(z) und (hAg)Afle) Chogoffe), 


also—da die Menge hogof(z) einpunktig ist— ho (g A f) (£) =hogof(z) 
== (h A g) A f(z). Demnach ist U auch ausgezeichnet inbezug auf ho(g Af), 
mithin ist A A (g Af) definiert; weiter stimmen h A (g Af) und (h Ag) 
Af auf U überein, daher ist nach Proposition 3.4.2 


hA(gAf)=(hAg) Af. 


Es lässt sich leicht allgemein zeigen, dass, wenn die meromorphen Pro- 
dukte AA (g Af) und (hAg) Af beide definiert sind, stets h A (g Af) 
== (hAg) Af ist. 


.Eine meromorphe Abbildung f: X—>Y heisst bimeromorph, wenn 
m 
ft: Y—>X eine meromorphe Abbildung ist. Sei f bimeromorph. Dann 


ist f surjektiv und, da f* insbesondere stetig ist, eigentlich. Weiter ist f* 
mit fe=(f')-* bimeromorph. Wird @[f] CX XY vermöge der durch 
(z,y)> (92) (x€ X, y€ Y) gegebenen biholomorphen Abbildung X X Y 
Y XX mit G[f*] C F X X identifiziert, was im folgenden geschehen soll, 
so hat man r[f*] =; also ist f —r[f +] o r[f] > und ft =—r[f] 0 r[f 7]. 
Das in X dichte Gebiet Ux: = X — (S (f) UF?(S(F*))) wird vermöge f 
biholomorph auf das in Y dichte Gebiet Uy: —Y— (S(f*) Uf(S(f))) 
abgebildet und umgekehrt Uy vermöge f" biholomorph auf Ux; denn X—$(f} 
wird vermöge r[f]" biholomorph auf G[f]—r[f]=(S(f)) bezogen und 
Y—S(f*) vermöge »[f*]* biholomorph auf auf G[f] —z[f*]*(8(f)). 


1° Diese Erklärung gilt auch für reduzible Räume X, Y. Ist X irreduzibel, was 
oben gemäss der Verabredung auf p. 838 vorauszusetzen ist, so ist Y, wenn eine bi- 
meromorphe Abbildung f: X —> Y vorliegt, von selbst ebenfalls irreduzibel. 
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Demnach ist Ux ausgezeichnet inbezug auf f!of, und fiir se Ux ist 
Fofle) =a; also ist ft A f: X Te nach Proposition 3.4.2 die identische 


Abbildung. 
Sei g: Y—>Z eine weitere bimeromorphe Abbildung, dann sind g Af: 


X 4 und fs Agi: Z ~x definiert. Die Korrespondenz (AN: 
2X ist jedenfalls isomo und irreduzibel, denn der Graph von 


(g A f)* ist als irreduzible analytische Untermenge im Graphen der holo- 
morphen Korrespondenz (gefJ>’—=ftog?!: Z—> X enthalten. Es wird nun 


Ux : == X— (S(f) UP*(S(F*)) U F7(8(9)) Uftog?(9(g+))) vermöge 
gof: X—>Z biholomorph auf 2 
k 


Uz = Z— (S(g*) U g(8(9)) U g(S(F*)) Ugo FEN) 
abgebildet und umgekehrt Uz’ vermöge (gof) biholomorph auf Ux’ (Ur 
ist ein in X dichtes Gebiet und Uz’ ein in Z dichtes Gebiet). Daher ist Ux’ 
ausgezeichnet inbezug auf gof und Uz’ ausgezeichnet .inbezug auf (gof). 
Sei z beliebig in Uz gewählt und (gof)*(e)=:z. Wegen g A f(z) 
=—gof(z)==g ist dann auch (g Af)=(z)—=z, und es ist ebenfalls 
F A g> (z) =f > 0 g> (z) =z. Demnach ist Us’ ausgezeichnet inbezug auf 
(g A f)™, und es folgt, dass (g A f)-* eine meromorphe Abbildung, dass also 
g Af mit`g und f bimeromorph ist. Wegen (g Af)+ | Ur =f Ag | U2" 
ist nach Proposition 3.4.2 ferner (g Af)t=ftA g`. 

Wir stellen noch fest, dass jede eigentliche Modiakshonaabbiläung bi- 
meromorph ist. - r 


3. PROPOSITION 4.3.1. Es seien f: <—>Y,fhı: X—>Yı, mero- 
m "m 
morphe Abbildungen, f sei eigentlich. Dann sind auch {f, f1}: X—— Y XY., 
und {fof}: X—— Y, XY eigentliche meromorphe Abbildungen. 
f m 
Beweis. Nach Proposition 3.3.2 sind die holomorphen Korrespondenzen 
(f, fa): sen YXY, und (ff): YıXY eigentlich. Dann sind 


aber .auch alle in (f,f:) bezw. (faf) anhalen holomorphen Korrespon- 
denzen eigentlich, insbesondere {f, f1} und {fa f}- 
PROPOSITION 4.3.2. Es seien f: X —>Y und g: Feed meromorphe 
i m 


Abbildungen, derart, dass g Af: X—>zZ definiert ist. Dan gen 


(a) Sind f und g eigentlich, so ist auch g Af eigentlich: 
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(b) Ist g Af eigentlich, so ist f eigentlich. Ist überdies f surjektw, 
so ist auch g eigentlich. 


Beweis. (a) Die holomorphe Korrespondenz gof: X —>Z ist eigent- 
k 


lich (Proposition 3.3.1); gleiches trifft dann für die in gof enthaltene 
meromorphe Abbildung g Af za. 


(b) Es sei UCX eine inbezug auf g of: X—>Z ausgezeichnete offene 
k 


Menge. Für jeden Punkt ue U ist mit gof(u) stets »[g]of{w) eine 

einpunktige Menge; U ist daher auch ausgezeichnet inbezug auf «[g|-tof =: 

X—— G[g]. Mithin ist das meromorphe Produkt a[g]tAfm:¢: 
k 


X-—>.@[g] definiert. Für we U gilt nun 
m 


g Aflu) =gof (u) =ĝ onig] of (u)=ĵfop(u) =fogor[e]"(u); 
auf Grund von Proposition 3.4.2 ist also E 


g Af= (608) Arts? =f opori] 
Es ist ferner 


[g] ° $(u) —a[9] omg} + 0 f(u) = f(u), 


mithin »[g] °$ or[¢$] (u) =f (u), woraus sich x[g] opon[p]* =f ergibt. 

Da g Af als eigentlich vorausgesetzt ist, folgt wegen g Af=ge go a[o|+ 
aus Proposition 3.3.2, dass god und somit ¢ eigentlich ist. . Wegen 
a[g]° porle] = f ist dann nach Proposition 8.3.1 auch f eigentlich.. 

Ist f ‚surjektiv, so muss auch & surjektiv sein. Denn träfe dies nicht zu, 
so wäre $(G[¢]) eine von @[g] verschiedene analytische Menge in G[g], 
und es wäre dann x{g]o$(@[¢]) alg] ogon[$]*(X) =f(X) von Y 
verschieden. Aus der Eigentlichkeit von gog und der Surjektivität von $ 
folgt nun, dass ĝ und mithin g eigentlich ist. 


5. Maximale meromorphe Abbildungen. 


5.1. Sei f: X r eine meromorphe Abbildung. Der Rang r(f) 


von f ist gemäss 3.4 i als der Rang r(f) der f durch Liftung nach 
Gif] zugeordneten holomorphen Abbildung f: G[f]— F. Ist f. insbesondere 
eine holomorphe Abbildung, so ist r(f) der globale Rang von f in dem für 
holomorphe Abbildungen definierten Sinne. Für jeden offenen irreduziblen 
komplexen Unterraum X, von X gilt r(f | Xo) =r (f). 


4 Es sei daran erinnert, dass—wie in 4.2 festgelegt—Urbildriume meromorpher 
Abbildungen stets als irreduzibel vorausgesetzt werden. 
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Für zwei meromorphe Abbildung f: XY > Y und fs: X —> Y, ist stete 
kaid m 


r({f,fo}) = max(r(f),r(fa)). Wir sagen, fo sei von f abhängig, wenn 
r({f,fo}) =r (f) gilt (insbesondere ist dann r(f) =r(fo)). Ist foe von f 
abhängig und f von f, abhängig, so heissen f und f, analytisch verwandt.—Es 
lässt sich leicht nachweisen, dass folgendes gilt: 


(a) Sind die Abbildungen fi: Xr und fi: X—>¥, von j 
abhängig, so ist auch {fo f1}: X—> 7X F, von f abhängig, und {f, fo} 
sowie {f, f1} sind mit f analytisch BRNA 

(b) Ist fo: X—> F, von f abhängig und “fy: XY — Yo von fy 
abhängig, so ist auch H von f abhängig. . 

Es gilt ferner 


(c) Ist g: Y—>Z eine meromorphe Abbildung, derart, dass g Af: 
m 
X—>Z definiert ist, so ist g Af von f abhängig. 
m r 


Beweis. Wegen Proposition- 4.2.2 lässt sich in X ein dort dichtes 
irreduzibles Gebiet V wählen, derart, dass f| V und gof|Y holomorphe 
Abbildungen sind. Da g(f(v)) für jeden Punkt ve V eine einpunktige Menge 
ist, bleibt gof | V auf den Fasern von f | V-konstant. Es folgt, dass gof | V 
von f | V abhängig, also r(f| V,gof|V)—r(f|V) ist. Wegen 


FIV gF =g AY =g ANY, 
MEG AP | =g AP) und r(t | V) =r (i) 


ist dann auch r({7,g A f}) —r (f). 


Ist f: X—> ¥ eigentlich, wird ausser X auch Y als irreduzibel vorausge- 
= ; 


setzt, und ist dim X == dim Y =r (f), so lässt sich ein Abbildungsgrad von 
f erklären: Sei Æ die Entartungsmenge von f: G[f]—> F, es werde My’: 
=r [f] (E) US(f), Mi= fM), Mi= HGM) gesetzt. My, My sind 
von X bezw. Y verschiedene analytische Mengen, es gilt f(M.) —M,, 
f (M:) —M,, und die durch Beschränkung von f bestimmte holomorphe 
Abbildung f’: X — M, —> Y — M, ist eine eigentliche Überlagerungsabbildung. 
. Die Blätterzahl der analytischen Überlagerung (X — M, f, Y —M,) sei nun 
als Abbildungsgrad g(f) von f bezeichnet. Wir nennen das Tripel (X, f, F) 
eine- meromorphe Überlagerung oder m-Überlagerung von Y und f eine 
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eigentliche meromorphe Überlagerungsabbildung; g(f) heisst die Blätterzahl 
der Überlagerung. 


Es gelten die leicht nachzuweisenden Aussagen: 

(I) Sind f:X BR. und g: P—>Z eigentliche meromorphe Über- 
lagerungsabbildungen, A it gAF:X Zr, definiert und eine eigentliche 
meromorphe Überlagerungsabbildung ma a(g Af) =a(g)-a(f)- 


(II) Eine meromorphe Abbildung f: X——>Y ist genau dann bimero- 
morph, wenn f eine eigentliche meromorphe Urnoa iiy mit 
g (f) = bist. 

Als Folgerung hieraus ergibt sich: Ist f: X—>Y surjektw und g: 
Y—>X so beschaffen, dass g Af: X—> X die identische Abbildung von 


x ist, so sind f und g bimeromorph, und es ist g=f!. Denn nach Proposi- 
tion 4.3.2 sind f und g eigentlich; es ist ferner dim X =r (f) —-dimY und 
dim Y= r(g) = dim X, also dim X = dim Y =? (f) —-r(g). Demnach sind 
f und g eigentliche meromorphe Uberlagerungsabbildungen; wegen g(g Af) 
1 gilt g(f) =—g(g)=1. Also sind f und g bimeromorph, und es ist 
g=9 A FAF = (Gg Af) Aft—fr. 


5.2. -In Analogie zu Proposition 1.2.2 gilt 

PROPOSITION 5.2.1. Set f: X—>Y eine meromorphe Abbildung, A 
eine irreduzible analytische Menge in X, derart, dass f| A definiert und 
eigentlich und dass r(f) =r(f| A) ist. Dann ist (f| A) (A) = f(A) == f(X), 
und f(X) ist eine Hf) diensionate irreduzible analytische Menge in Y. 

Beweis. Es sei A, C A ein irreduzibles und inbezug auf f | A: a Y 


ausgezeichnetes Gebiet. Vermöge »[f]”* wird A, auf ein irreduzibles Gebiet 
’A, in der analytischen Menge »[f](A) C @[f] bijektiv bezogen. Sei ’A 
diejenige irreduzible Komponente von [f]"(4A), die ”A, umfasst, weiter 
’a:’A—>A die durch Beschränkung von r[f] bestimmte holomorphe Abbil- 
dung. ‘a ist eigentlich, und ’A, wird auf A, vermöge ’« bijektiv abgebildet; 
infolgedessen ist ‘a eine eigentliche Modifikationsabbildung. Die meromorphe 
Abbildung (f |’A) A'a = (7 |’A) o'a: A—>Y stimmt auf A, mit f | A 
m m 


überein, daher ist (f|’A)0o’at—f|A. Da f|A eigentlich ist, hat f |4 
m "n 


11 
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nach Proposition 3.3.2 diese Eigenschaft auch ; ferner ist r (f I A) = 5 ’A) 
und r(f) =r(?), also a |’A)=r(f). Es ist nun 
(fF) 4) (4) = AA) |’A) (A) ma 


und f(X) =f(r[f}*(X))=f{G[f]). Nach Proposition 1.2. 2 ist CA) 
= ?(G[f]), mithin ist (f I A) (4) =f(X) und f(X) — (A) eine irreduzible 
analytische Menge der Daad r(f) ==r(f). Wegen (f l A) (4) E F(A) 
C f(X) ist dann auch (f | 4) (4) =f (4) =f (Z). 

Wir benötigen Er . 


PROPOSITION 5.2.2. Ser f: X ee eine meromorphe Abbildung, A 


eine irreduzible lokal-analytische Menge in X, derart, dass X in allen 
Punkten von A irreduzibel und dass f | A definiert und r(f) =r(f| A) ist. 
g m m. 


Dann ist für jede von f abhängige meromorphe Abbildung fo: X—> Yo die 
m 
meromorphe Beschränkung fo | A: A—>TY, definiert. 
m m 


Beweis. 1) Wir setzen den komplexen Raum X zunächst als: normal 
voraus. (X ist dann insbesondere in allen seinen Punkten irreduzibel.) 
In diesem Falle ist auf Grund von Proposition 4.1.3 die meromorphe Be- 
schränkung auf A einer meromorphen Abbildung genau dann definiert, wenn 
es auf A wenigstens einen nichtsingulären Punkt inbezug auf die Abbildung 
gibt. Deswegen darf angenommen werden, dass f eine holomorphe Abbildung 
ist: Nötigenfalls ist X durch eine hinreichend kleine zusammenhängende offene 
Umgebung eines inbezug auf f nichtsingulären Punktes von A zu ersetzen. —Es 
ist zu zeigen, dass A nicht in der analytischen Menge S (fo) — :8,.der ausser- 
wesentlichen Singularitäten von f, enthalten ist. 

Angenommen, es gälte A C So. Dann sei Sọ’ eine irreduzible Katy 
nente von So die A enthält; wegen r(f|A)<=r(f|S.’)Sr(f) und 
r(f)—=r(f| A) gilt r(f) =r(f| So’). Die Menge »[fo]*(8,°) ist analytisch 
in G[f], und die durch Beschränkung von [fo] bestimmte holomorphe Abbil- 
dung [fo] (80) > 8,’ ist eigentlich und surjektiv; es gibt dann auch ‘eine 
irreduzible Komponente 78,’ von m[fo] = (80), die vermöge [fo] eigentlich 
auf 8,’ abgebildet wird. Es ist r(r[fo] |87) < dim’S,’. Denn für jeden 
Punkt "se a[fol*(So’) ist die Faser [fo] (r[fo](’z.)) eine mindestens 
eindimensionale zusammenhängende analytische Menge, da entsprechendes 
für fo(w[fol (’@o)) gilt und a[fol"(m[fo](’z0)) auf folr[fo] (20) ) vermöge 
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dere holomorphen Abbildung fo: G[fo]—> Yo bijektiv bezogen wird. Ist ‘zo 
insbesondere ein Punkt von ’8,, der auf keiner weiteren irreduziblen Kom- 
ponente von x[fo]*(So’) liegt, so muss die Vereingung der durch ’z, laufenden 
irreduziblen Komponenten von »[fol"(r[fo] (’20)) in ’So’ enthalten sein und. 
daher mit der Faser von [fo] | ’8,’ durch ‘x, übereinstimmen ; infolgedessen 
ist der lokale Rang von [fo] | ’8,’ in “zo kleiner als dim’S,’. Da die Menge 
derartiger Punkte ’z, auf ’S,’ dicht liegt, gilt mithin r (#[fo] | So)’ < dim’S)’. 
Jede Niveaumenge von [fo] | “So” ist demnach mindestens ein dimensional. 

Es werde weiter ’f:=for[fol: G[fo] > Y gesetzt. Dann folgt, dass 
r(‘f | So’) —r(f | So’) ist. Denn ist B,’ eine offene nichtleere Teilmenge von 
8,’ mit abzählbarer Topologie, so ist f(B,’) ein topologisch-2r (f | Su’) -dimen- 
sionaler topologischer Unterraum von Y (vgl. [26], Satz 1). Es ist weiter 
[fo] (Bo) N'S = :’B,’ eine offene Menge in ’8 mit abzählbarer Topo- 
logie, und es gilt [fo] Bo’) — Bu, also FBy) (By); da FCBS) ein 
topologisch-®r (’f | 8,’)-dimensionaler topologischer Unterraum von Y ist, 
muss also r(f | So’) =r(’f | ’So’) sein—Hs ist r(f) =r(’f), demnach auch 
rf) =r CF | 80’). 

Da f, von f abhängig ist, ist fẹ, von f’ abhängig. Die Abbildungen ’f und 
(‘f, fo): G{fol > ¥ XY, sind also analytisch verwandt. Gleiches muss auch 
für die Beschränkungen ’f|’S’ und (F, fo) |’So = (’f | ’S0’, fo |’So) gelten. 
Denn es ist 


POEIRA SCF | S, Fo 188) = CE Po) 8) Sr), 


wegen der analytischen Verwandtschaft von ’f und (f, fo) ferner r(’f) 
—r((/f,fo)) und wie oben festgestellt r(’f) =r (f | So’). Daher ist 

l rf | So’) E CCF, fo) | 8) Sr(CF, fo) = rC =r CF | 780"), 

mithin r(’f| So’) =r ( (f, fa) |87). Nunmehr lässt sich wie folgt ein 
Widerspruch herbeiführen: ’f | 8,’ ist wegen ’f=for[fo] auf den Fasern 
der holomorphen Abbildung [fo] | So’: ’So’ —> X konstant, also ist ’f | ‘So’ 
von [fo] | ‘So’ abhängig. Dann müsste auch (’f,fo) | 8. von [fo] | So’ 
abhängig sein, (’f,?o) | 8.’ müsste auf den Niveaumengen von [fo] | ‘So’ 
der kleinsten vorkommenden Dimension konstant bleiben. Dies kann jedoch 
nicht zutreffen: Denn (’f, fo) | ’So’ ist auf einer Niveaumenge von [fo] | ’So’, 
die mehr als einen Punkt enthält, niemals konstant, da jede Faser von [fo] 
vermöge fo injektiv abgebildet wird; jede Niveaumenge von [fo] | ’So’ ist 
aber mindestens eindimensional, wie sich oben ergeben hat. 


2) Es werde nun die Annahme über die Normalität von X fallengelassen 
und nur noch vorausgesetzt, dass X in den Punkten von A irreduzibel ist.— 
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Sei (”X,v,X) eine Normalisierung von X. Dann wird A vermöge v* auf die 
lokal-analytische Menge ”A:=v"!(A) CX bijektiv bezogen; es folgt, dass 
“A irreduzibel und dass die durch Beschränkung von y bestimmte holomorphe 
Abbildung ”A>A ein Homöomorphismus ist. Wird weiter “f:=f Av 
"X —>X und “fo:—=foAv: et gesetzt, so ist f=-"FArt, fo 


h A v und ”f, von ”f abhängige Nach Voraussetzung ist f q A definiert, 
sei A, CA eine inbezug auf f| A: A—>Y ausgezeichnete Gin Menge. 
hb 


Für “sev (A) ist “f (2) =f Av(’x) Cf(v(’e)). Wegen v(”z) € A, ist 
die Menge f(»(”z)) einpunktig, dies trifft also auch für ”f(”z) zu. Somit 
ist v!(A,) C”A eine inbezug auf ”f|”A:—>Y ausgezeichnete Menge, 
k e 
"f |”A ist demnach definiert. Nach dem ersten Teil des Beweises ist nun 
m 
f |”4 definiert. Sei “A,C”A eine inbemg auf “f,| A: “A—>T. 
ausgezeichnete offene Menge. Für zev(”A,) ist 
fo(t) "fo A > (2) Create), | 
mithin ist f,(z) eine einpunktige Menge. »(”A,) C A ist daher eine inbezug 
auf fo | A: A—>Y, ausgezeichnete Menge, fo | A ist also definiert. 
$ m 


Bemerkung. Es lassen sich leicht Beispiele dafür angeben, dass die 
Behauptung von Proposition 5.2.2 ohne die Voraussetzung der Irreduzibilität 
von X in den Punkten von A falsch ist. 


PROPOSITION 5.2.3. Sei f: X—>Y eine meromorphe Abbildung, A 
eine irreduzible analytische Menge in X, derart, dass f | A: A—>Y definiert 
und eigentlich und dass r(f) =r(f | A) ist. Es set f: IY, eine von f 
abhängige meromorphe Abbildung, für welche fo | A dann ae Dann gilt: 

1) fo | A ist von flA abhängig ; 

2) (fol 4) (4) =f (4) =f (£); 

3) r) =r(fal A). 

Beweis. Wegen Proposition 4.2.2 lässt sich eine offene Menge A, C A 
wählen, die sowohl inbezug auf f| A: Ao ee. wie auf f,| A: At 


ausgezeichnet ist. A, ist dann auch inbezug auf (f,fo)| A ausgezeichnet. 
Für v€ A, gilt {f, fo} (£0) C (f, fo) (to) = ( (F, fo) | A) (wo) und 


CF | Afo | 4} (a) © (fs fo) (0) = ( (F, fo) | £) (20), 
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mithin sind {f, fo} (£o) und {f| A,fo | A}(z) einpunktige.und gleiche 
& m m + 
Mengen. A, ist daher ausgezeichnet inbezug auf {f, fo} | A: A —> Y X Found 
. Gs 
es ist {f, fo} | 4o = {f | 4,fo| A} | 40; infolgedessen ist {f, fo} | A definiert 
und, wegen Proposition 3.4.2, mit {f | A, fo | A} identisch. Es gilt 


r({f fo} | A) SrA fo}) 


(dies ergibt sich durch Übergang zu der {f, fs} durch Liftung nach G[{f, fo}] 
zugeordneten Abbildung mit Proposition 1.2.1), daher ist 


AR | A) = PAR fo) Verde. 


Andererseits ist r(f | JS r({f | Afo | A)), sodass r((f | A, fo | A ) =G | A) 
folgt; fo | A ist also” von f | A abhängig. " í j 

Es folgt auch r({f, i) 14) —r({f, fo}). Weiter ist nach Proposition 
4.3.1 mit fl A auch {f l 4, = l A} ti | A eigentlich. - Nach TE 
tion 5.2.1 ist dann 

{f | A, fo | 4}(A) = (ff, fo} | 4) (4) =f) (A) ER 

‚und .{f,fo}(X) ==:M eine irreduzible analytische Menge der Dann 
rh fo} | 4) =r(f) in ¥ X Yo. Bezeichnet oo: F-X Yo-> Fo die natürliche 


Projektion, so ergibt sich mit Proposition 3.4.2, dass fyo==oo A {f, fo} und 
fo | A = o0 A {f | A, fo | A} ist. Man hat demnach fy(X) = (oo A {f, fo}) (X) 


= (90° {fs fo}) (X) = ool {f, fo} (X)) =oo(M) und 
(fo | 4) (4) = (oA {f1 4, fo] 4) (A) 
= (coo {f | Afo | 4}) (A) —oo({f | 4, fo! A}(A)) oe), 


also (fo 4) (A) =7,(X) und dann auch f(A) -== fo(X). 
Es ist weiter r(fo) =r(oo | M) und r(f, | 4) =r (co | M). Zum Nach- 


weis der ersten dieser Beziehungen sei U eine offene nichtleere Menge mit ab- 
zählbarer Topologie in X, derart, dass jeder Punkt von U nichtsingulärer Punkt 
inbezug auf fẹ und {f, fo} ist und dass in jedem Punkt von U der lokale Rang 
der holomorphen Abbildung {f, fo} | U mit dem Rang r({f, fo} | V)=r({f, fo}) 
=r(f) übereinstimmt. Es ist dann {f, fo} (U) eine offene Menge mit abzähl- 
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barer Topologie in M und os({f, fo}(U)) — fo(U) eine Menge der topologischen 
Dimension ®r(o, | M) in Yo, andererseits ist die topologische Dimension von 
j(U) gleich 2r(fo) (vgl. [26], Satz 1). Demnach ist r(fo) =r(oo | M). Ent- 


sprechend ist r(fo | A)=r(o, | M) nachzuweisen, sodass dann r(fo) = r(fo | A) 
m „m 
folgt, wie unter 3) behauptet. 
Bemerkung. Die Behauptung 1) der Proposition 5.2.3 gilt, wie sich 


aus dem Beweis ergibt, schon dann, wenn A nur eine lokal-analytische Menge 
ist und die Eigentlichkeit von f l A nicht gefordert wird. Es lässt sich zeigen, 


dass 3) ebenfalls schon in Ben Falle zutrifft. 


5.3. Wir sagen, die meromorphe Abbildung fo: X —> Y, m-majorisiere 
die meromorphe Abbildung fi: X —— Y,, wenn eine ones Abbildung 
a: 7, —>Y, existiert, derart, Ban A fo definiert und fia A fo ist. Die 
enihorpie Abbildung ft: X = Y* heisst m-maximal, wenn sie surjektiv 


ist und wenn sie jede von f* abhängige meromorphe Abbildung m-majorisiert. 
Ist f? m-maximal und f: X—>Y irgendeine mit f* analytisch verwandte 
m 


meromorphe Abbildung, so nennen wir das Paar (f*, Y*) eine komplexe m- 
Basis zur Abbildung f. 


Es ist zweckmässig, noch eine Erweiterung des Begriffs der m-Maxi- 
malität einzuführen. Sei f: X<—>Y eine meromorphe Abbildung. Eine 


2 
Klasse % von meromorphen Abbildung von X heisst eine f-Klasse, wenn gilt: 
(1) f gehört u $. 
(2) Jede Abbildung ¢ € % ist von f abhängig. 
(3) Gehören ¢,: <—>TY, und 5: X —— Y, zu 5, so auch {d1, do}: 
ZÄ—L[Y,xY. 


(4) Gehört ¢: re zu % und ist (X) in einem komplexen 


Unterraum re von Y’ enthalten, so gehört die oe do: 
2er von d auf Y’, zu F. 


Eine surjektive meromorphe Abbildung f* aus der f-Klasse % heisse %- 
maximal, wenn jede Abbildung aus % von f* m-majorisiert wird. 
Sind ff: X—Y*, f,*: X—+ Y,* zwei §-maximale Abbildungen, so 
m m 
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hat man surjektive meromorphe Abbildungen 8: Y,*—>Y* und £: 
Y*——» F,*, derart, das = 8 A fi” und fi 8, A f* gilt. Wegen 5.1, 
Aussage (c), sind f* und fı* demnach analytisch verwandt. Weiter ist 
ft—BA (8A f*) = (BAR) Af*; es folgt, dass die meromorphe Ab- 
bildung 8 A ßı: ¥*—> Y* sicher in jedem Punkt der Menge 
f*(X—8(f*)) —S(B AB) C F” 


mit der identischen Abbildung von Y* übereinstimmt. Wegen der Surjek- 
tivität von f* liegt (X —S(f*)) dicht in Y*; mit Hilfe von Proposition 
3.4.2 ergibt sich also, dass 8 Af, die identische Abbildung von Y* ist. 
Dann abér sind £ und £, bimeromorph, und es ist 8B, == 8 (vgl. 5.1, p. 845). 
Wir nennen f* und f,* bimeromorph äquivalent. 

Zum Begriff der f-Klasse seien einige Beispiele betrachtet. 


1) Die Klasse aller von der Abbildung f: X —> Y abhängigen mero- 
m 
morphen Abbildung ist eine f-Klasse. 
2) X sei eine irreduzible analytische Menge in einem komplexen Raum 
*X, der in allen Punkten von X irreduzibel sei; *f: *X—>T sei eine mero- 
m 


morphe Abbildung, derart, dass *f| X —:f definiert und eigentlich und dass 
n 


r(*f)=r(f) ist. Es sei *% eine *f-Klasse. Für jede Abbildung *¢ € *% 
existiert auf Grund von Proposition 5.2.2 die meromorphe Beschränkung 
*p|X—=:¢. Es wird behauptet, dass diese Abbildungen ¢ eine f-Klasse $ 


(die auch mit *% | X bezeichnet sei) bilden. 


Es ist zu prüfen, ob die obigen Bedingungen (1)-(4) für % erfüllt sind: 
(1) trifft trivialerweise zu; (2) gilt auf Grund von Proposition 5.2.3. Zu 
(3): Sind Abbildungen ¢,€ %, ¢2€ § mit 


i= "da | Z, a= *h2 |X (*h1 E “D, he E *H) 
gegeben, so gehört {*1,*¢2} zu * und {*4:, *¢a} | X ist definiert. Sei U 


eine offene Menge in X, die zugleich inbezug auf die holomorphen Korre- 
spondenzen *¢, | X und *¢, | X ausgezeichnet ist. Für ze U gilt 


(bu #4) | X) (2) = ("ass ha) (2) = (4 | X, "he | X) (2); 
auf Grund von Proposition 3.4.2 ist also 
ano) | Z= (os | Z, "ha | X} = (42 oa}, 
demnach gilt (3) für %.—Zu (4): Sei ŞƏ peo mit gum 7 |X, 
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*ġ E *y;esseib(X) in einem irreduziblen komplexen Unterraum ’Y, von ‘Y 
enthalten, sei ¢o: X—>’Y, die Beschränkung von & auf ’Y,. Nach 
, Me . 3 


Proposition 5.2.3 ist #4 (X) = (X), also *ġ(*X) C ‘Yo. Die Beschrän- 
kung *6.:*X—>’Y, von *p auf ’Y, gehört zu *%, und es ist offenbar 
m = 


om *$o | T. Also ist (4) für § erfüllt. 


3) X, *X, f, *f mögen die gleiche Bedeutung wie im Beispiel 2) 
haben; es ist dann leicht ersichtlich, dass X in *X ein Fundamentalsystem 
u(x) irreduzibler offener Umgebungen besitzt. Es sei % die Klasse der 
wie folgt beschaffenen meromorphen Abbildungen von X: Zu jeder derartigen 
Abbildung ¢ existiere eine Umgebung *U,EU(X) und eine meromosphe. Ab- 
bildung *# von *Ug, derart, dass ¢ meromorphe Beschränkung von *¢ auf 
X und dass * von *f | *U’, abhängig ist. Dies lässt sich auch so ausdrücken: 
Jedes  € ist “ meromorphe Beschränkung” eines von f abhängigen “ mero- 
morphen Abbildungskeims auf X.” Es wird wieder behauptet, dass % 
eine f-Klasse ist.—Der Beweis verläuft entssprechend wie zu 2) (an Stelle 
der Abbildungen aus *% hat man meromorphe Abbildungen zu nehmen, die 
jeweils in zu U(X) gehörenden Umgebungen von X definiert und dort von 
*f abhängig sind). 

` Die folgende Aussage ist unmittelbar nachzupriifen : 


‘ PROPOSITION 5.3.1. Sei f: X + eine meromorphe Abbildung, 
ı’X =X eine _ bimeromorphe Abbildung, 3 eine f-Klasse meromorpher 


Aihan Es sei 'f:=f Ar gesetzt. Dann bilden die Abbildungen 
'p:=p Ar, PCR, eine ’f-Klasse '%, und die durch 6>¢Ar gegebene 
Zuordnung B'S ist bijektiw. Einer $-mazimalen Abbildung entspricht 
vermöge dieser Zuordnung eine '3-mazimale Abbildung. 


5.4. Wir beweisen eine weitere Hauptaussage dieser Arbeit. 
Sarz II. Saf: X ae Y eine eigentliche meromorphe Abbildung. Dann 


gibt es in jeder f-Klasse 3 von meromorphen Abbildungen eine mit f 
analytisch verwandte S-mazimale eigentliche Abbildung. 


Beweis. Es darf vorausgesetzt werden, dass der komplexe Raum X normal 
und die Abbildung f holomorph ist. Denn trifft dies von vornherein nicht 
zu, so wird eine Normalisierung (’X,v,@[f]) des Graphen G[f] betrachtet; 
dann ist (X, r[f] ov, X) eine eigentliche Modifikation und f:=FA (a[f].0¥) 
= fov: ’'X—>F eine eigentliche holomorphe Abbildung. Es wird nun X, 
f durch ’X, ’f ersetzt und gemäss Proposition 5.3.1 von % zu der aus den 
meromorphen Abbildungen ’$:==¢ A (a[f] ov), $€ %, bestehenden ’ f-Klasse 


MAXIMALE HOLOMORPHE. UND MEROMORPHE ABBILDUNGEN, I. 853 


/% übergegangen; es genügt dann, die Behauptung für ’% statt für % nach- 
-zuweisen.-—-Wir kehren zu den alten Bezeichnungen X, f, %. an Stelle von ’X, 
"f, Y zurück. 

Wegen der Eigentlichkeit von f ist das Bild f(X) :=— F, eine irreduzible 
r(f)-dimensionale analytische Menge in Y. Die Beschränkung fo: X —> Y, 
von f auf Y, ist surjektiv, eigentlich, mit f analytisch verwandt und sie gehört 
za %. Wir betrachen die Klasse § derjenigen surjektiven meromorphen 
Abbildungen aus 9, die f, m-majorisieren (insbesondere gehört fọ zu 8). 
Ist fi: X en, irgendeine Abbildung aus $, so ist Y; irreduzibel, und man 

m 


hat eine meromorphe Abbildung u: Fı—> Y, mit fo = a; A fi; daher ist fe 
m 


von fi"&bhängig. Andererseits ist fı von f, also von fy abhängig, infolge- 
dessen sind fı und fe analytisch verwandt, und es ist r(fù) =r (fo). Nach 
Proposition 4.3.2 ist mit f, auch f, eigentlich, und gleiches trifft, da fi 
surjektiv ist, für a, zu; ferner ist a, mit fọ surjektiv. Demnach gilt r(«) 
== dim F; = r (fi) =r (fo) = dim Yo. Das Tripel (Yi, Yo) ist also eine 
meromorphe Überlagerung von Fo, sei gi: g(a) ihre Blätterzahl. Es gibt 
jeweils in Y, bezw. Y, eine von F; bezw. Y, verschiedene analytische Menge 
M, bezw. Mo, derart, dass (M) =Mu sowie (My) = M, ist, dass 
u | F;— M; eine holomorphe Abbildung und dass die durch Beschränkung 
von &; bestimmte holomorphe Abbildung ’a,: Y;—M,;— Yo.— Mu eigentlich 
und lokal biholomorph ist; über jedem Punkt von F u; a dann 
vermöge "04 genau g; Punkte von Y,—M,. 

Die Menge SG:=f(8(f)) ist eine suisse Menge in Y;; wir be- 
haupten, dass sie von Y; verschieden ist. Angenommen, es sei Sj==Y;. Der 
Rang der eigentlichen holomorphen Korrespondenz fi | S(fi): 8(f) a Y; 


ist dann gleich dim Y, und es gibt eine irreduzible Komponente $/’ der 
analytischen Menge »[f]"(8(f)) C @[fi], derart, dass r(f.| S/) —dimY; 
-r(f)—=r(k) =r (fo) ist. Andererseits ist die Beschränkung von f, auf 
irgendeine irreduzible Komponente von 8(fi) eine holomorphe Abbildung, 
deren Rang kleiner als r (fo). ist; denn sonst müsste nach Proposition 5.2.2 
die meromorphe Beschränkung von f; auf diese Komponente definiert sein, 
und dies würde wegen der Normalität von X bedeuten, dass auf der Kompo- 
nente nichtsinguläre Punkte inbezug auf f, lägen, was nicht zutrifft. Es folgt, 
dass auch r(foo=[fi] |S’) <r(fo) sein muss. Nun ist die eigentliche holo- 
morphe Abbildung foor[fi]: G[k]—Y, von der eigentlichen holomorphen 
Abbildung fi== f; A r[fi]: G[k]>Fı abhängig (foor[fi] und f; sind sogar 
analytisch verwandt, weil fe und f; es sind). Nach Proposition 5.2.3, Be- 
hauptüng 3) gilt dann r(f,o-[fi] | S6) —=r(foomlfil) sda r(foom[fil) = rfo) 
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ist, folgt also r (fo o [fi] | 8/) = (fo), womit ein Widerspruch ist. 
S, ist mithin in Y; echt enthalten. 

Sei jetzt Ba: = Yo— (Mo U (8;)) und By: = Y, — MU CA -+(a4(8)))s 
B. und B; sind irreduzible offene dichte Unterräume von Y, bezw. Y, und 
es ist (B) =u (Bı) — Bo sowie ar'(Ba) == "at (Boa) = By... Es» sei 
"a: B> Bu die durch Beschränkung von a; bestimmte lokal-biholomorphe 
eigentliche Überlagerungsabbildung. Ist zy ein Punkt aus By und be- 
zeichnen m (y—1,-- ;g) die g Urbildpunkte von Ta vermöge “a, in 
By so hat man ft (20) = frt ("ar (ot) = Fit ( U {2}) = Ua). 


Da 2 nicht in &, liegt, sind die g; Fasern fr (240) paarweise punkiem. 
Die Faser fo* (zo) zerfällt daher in mindestens g; zusammenhängende Kom- 
ponenten, und dies gilt für jeden Punkt za € Bo. Andererseits sind wegen 
der Eigentlichkeit der holomorphen Abbildung f, alle Fasern von fo kompakte 
analytische Mengen, und diese zerfallen in jeweils endlich viele zusammen- 
hängende Komponenten. Es gibt also (Proposition 1.2.3) eine positive ganze 
Zahl 1, derart, dass die Menge derjenigen Punkte y,€ Yo, für welche die 
Faser fo(y.) höchstens /, zusammenhängende Komponenten besitzt, in einer 
nichtleeren offenen Teilmenge Fo von F, dicht liegt. Da By in Yy dicht ist, 
ist die offene Menge Boa N Eo nichtleer, demnach muss 41, gelten. :Die 
den HER zugeordneten Blätterzahlen bleiben also unter einer endlichen 
Schranke. 

Es sei nun fy: X =r Y; eine meromorphe Abbildung. aus, a derart, 


dass die Blätterzahl g; Sige zugehörigen meromorphen Überlagerung ( Yy Oy; Ya) 
maximal ist. Wir behaupten, dass f; eine gesuchte -maximale Abbildung. ist. 
In der Tat, ist ¢: X => Y* irgendeine Abbildung aus %, so gehört auch 


{fap}: <—T;x pe zu %. f; ist mit fo also mit f, analytisch verwandt; 


da & von f abhängig ist, ist @ also auch von f; abhängig, d.h: es gilt 
r(f) =r (f;) —r({f;,¢}). Nach Proposition 4.3.1 ist weiter {f,$} mit 
f; eigentlich. Daher ist das Bild {f;,¢}(X) —=:Yo* eine irreduzible r(f)- 
dimensionale analytische Menge in Y;XY*. Die Beschränkung: ¢,*: 
X— > Y,* von {fọ} auf Y,* gehört zu %, und sie ist surjektiv, eigentlich 


und mit {fẹ}, also mit f und fo analytisch verwandt. Es bezeichne 
©: Yo* > Y¥;X Y* die Injektion, weiter øo} bezw. o* die Projektion von 
Y;X Y* auf Y, bezw. auf Y*. Man hat f;—oj;0¢,°¢)*, demnach wird fy 
von ¢o* m-majorisiert. Es ergibt sich wiederum, dass (F,*, cjo <o Yj) eine 
m-Überlagerung ist (0;0«, ist sogar eine holomorphe Abbildung). Dann ‘ist 
auch (Yo*,a;A (ajoe), Yo) eine m-Überlagerung, und es ist ` = 


g(a; A (04%) ) = g(a) ` ghoz eo) = Gy" g (oye). 
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Nun gilt fom ay A fy = ay A (030 €a) 060°) — (ay A (042 e0)) A do*, also wird 
fo von $o* m-majorisiert ; mithin gehört $.* zu 8, und (Fo*, a; A (0,06), Yo) 
ist die zu ¢o* gehörige m-Überlagerung von Ye. Wegen der Maximalität 
von gj muss g(a; A (ojo eo) ) = gy gelten ; daher ist g (cj ° eo) = 1, und es folgt, 
dass oj° eo eine bimeromorphe Abbildung ist. Es ist dann 

(zo) A fy = (049 6) A ( (04% €0) © po) 

= ( (04060) ™ A (430%)) A po* = ġo". 

Nun gilt $=0*0&04,*, demnach hat man $==c* «0 ((0;° €)*A fy) 
== ( (o* o €9) © (a;%€,)*) Af; Also wird ¢ von f; m-majorisiert, w. z. b. w. 

Spezialisierung auf den Fall der f-Klasse aller von f abhängigen mero- 
morphen Abbildungen ergibt das 

KoRoLLAar zu Satz Il. Zu jeder eigentlichen meromorphen Abbildung 
f: X<—>T existiert eine mit f analytisch verwandte m-maximale eigentliche 


meromorphe Abbildung. 
5.5. Satz II lässt sich wie folgt erweitern: 
Satz III. Seif: X—> Y eine meromorphe Abbildung, ferner A eine 
m 


irreduzible analytische Menge in X, derart, dass die holomorphe Korrespondenz 
a:=f|4A:4 = Y wenigstens eine irreduzible Komponente a’: A oe Y 


besitzt, die Arei ist und für die r(a’) =r (f) gilt. Es sei % eine PE lasse 

meromorpher Abbildungen. Dann existiert eine mit f analytisch verwandte 

F-marimale meromorphe Abbildung f*: <—>TY* auf einen r(f)-dimen- 
m 


sionalen komplexen Raum Y*. 


Beweis. Sei (’X,»,@[f]) eine Normalisierung des Graphen G[f], es 
sei r: = r[f] oy gesetzt; dann ist (X, r, X) eine eigentliche Modifikation und 
Fı=fAr=fov:’X>Y eine holomorphe Abbildung. Auf Grund der 
Voraussetzung über f besitzt die analytische Menge 7*(A) eine irreduzible 
Komponente ’A, derart, dass ’f | ’A:’A—>F eigentlich und r(’f | ’A) =r(’f) 
==r(f) ist. Der f-Klasse % entspricht nach Proposition 5.3.1 vermöge der 
Zuordnung ¢—> ¢ Az, $.€ %, bijektiv eine ’f-Klasse ’%. Für jede Abbildung 
'sE’% ist nach Proposition 5.2.2 die meromorphe Beschränkung ’6 | ’A 


definiert, und nach Proposition 5.2.3 ist (X) =’ (4) = (’p |’A)(’A) 
m 
und r(’#) =r(’#|’A). Es folgt, dass für p=’ Ar*€ % die holomorphe 
m 


Korrespondenz a := ġ | A stets eine irreduzible Komponente g’ besitzt, derart, 
dass ¢(X) = ¢ (4) =a (4) =g (A) und r(a’)=r(6) gilt; ist ’& | ’A speziell 


eigentlich, so kann auch a’ als eigentlich gewählt werden, und die Bildmenge 
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a’(A) == ¢(X) ist dann eine irreduzible r(#)-dimensionale analytische Menge. 
—Auf Grund von Proposition 5.3.1 genügt es, die Existenz einer mit ’f 
analytisch verwandten ”S-maximalen meromorphen Abbildung auf einen r (’f)- 
dimensionalen komplexen Raum nachzuweisen. Wir benutzen im folgenden 
statt ’X, “A, ’f, ’% der Einfachheit halber wieder die Bezeichnungen X, A, 
5% 

Es sei f : =f | A gesetzt; dann bilden die duaia L EEA 
p :=o | A, € G, eine ¥-Klasse F =| A (vgl. oben Beispiel 2), p. 851). 

m 


Nach Satz II existiert eine mit f’ analytisch verwandte %-maximale eigentliche 
meromorphe Abbildung ?*: A—> Y*; wegen r(f’*) =r(f) und r(f’) =r(f) 
m 


ist Y* r(f)-dimensional. Sei f*: X —— Y* eine meromorphe Abbildung aue 
m 
5, derart, dass ?*=f*]A ist. Wir behaupten, dass f* eine gesuchte §- 
m ‘ 
maximale Abbildung ist. 


Sicher ist f* surjektiv, da dies für f’* zutrifft. Sei jetzt irgendeine 
Abbildung ¢: X —>’T aus % gegeben. Zur meromorphen Beschränkung 
m 


p :=¢| 4: A—’Y existiert dann eine meromorphe Abbildung p: 
m m 
Y*——»’Y mit =p Af*. Wir werden zeigen, dass auch ¢ = p A f* gilt, 
m 


womit die %-Maximalität von ft nachgewiesen sein wird; da insbesondere 
dann f durch f* m-majorisiert wird, folgt auch, dass f* mit f analytisch 
verwandt ist. 


Die meromorphe Abbildung $:—= p A ft: X—>’Y ist von f*, also von 
nh 


fh, abhängig; nach Proposition 5.2.2 existiert die meromorphe Beschränkung 
$ I A. Sei U CA eine zugleich inbezug auf die holomorphen Korrespon- 


ne $ | A, f* | A, po f’* ausgezeichnete offene Menge, dann gilt für se U: 
($ | A) (2) = ($ | 4) (2) = 4(2) = (kAF*) (2) C (no ft) (2) 
fee) =ef (P | A) (2) =C (f | A) (@)) 
Ref) = (HAT) (2) = 92), i 

also (| 4) (2) —=9"(2), da (uof’*)(e)—9"(x) einpunktig ist. Nach 
Proposes 3.4.2 ist daher 6|A4—¢’—¢|A. Wir behaupten nun allge- 
mein: Sind &: ern 8: I Ken zwei von f abhängige mero- 
morphe Aipadaien. fiir welche 5 I A=¢ i A gilt, so ist dd. 

Um dies nachzuweisen, wird oie Abbildung {8,9}: X Pa x'Y 
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betrachtet; {$,6} ist von f abhängig. Auf Grund von Proposition 5.2.2 sind 
die meromorphen Beschränkungen ¢| 4, $]4, {¢,¢}|A definiert. Ist 
V CA eine zugleich inbezug auf die holomorphen Korrespondenzen ¢| A, 
$| 4, {$,¢}| A ausgezeichnete offene Menge, so gilt für ze V: 
(16,8) | 4) (2) = (19, $} | A) (2) = {4,4} (2) C ($, $) (2) 
= ($ | 4, | 4) (= (614,8 | A) (2) = {$ | 4,614} (2), 


also ({6,8) |4) (2) = {$ | 4,6 |4} (2); nach 

{¢,¢}|A4=={6]4,¢|A}. Nach Proposition 5.2.3 gilt {¢,$}(Z) 
= (19/3) | 4) (4), somit ist (9) (X) = {$ | 4,6 | 4} (4). Wegen ¢|4 
—$|A ist nun {¢|A,¢|A}(A) in der Diagonale von ’Y X ’Y enthalten. 
Gleiches trifft also für {¢,¢}(X) zu, woraus folgt, dass ¢ und $ jedenfalls 
in allen Punkten von X, die zugleich inbezug auf ¢ und ’& ausgezeichnet 
sind, übereinstimmen. Auf Grund von Proposition 3.4.2 muss dann dd 
gelten, wie behauptet.—Damit ist auch Satz III bewiesen. 

Wir notieren noch die folgenden 


Zusätze zu Sarz III. (1) Die holomorphe Korrespondenz a*: = f* | A: 
. A—>Y™ besitzt eine irreduzible Komponente a: A ——> Y*, die eigentlich 
k è 


ist und für die r(a*’) ==r(f*) ==r(f) sowie at (A) =¥F* gilt. 
(2) Die meromorphe Abbildung 8: Y*—> Y, für welche f =8 A f* 
m 
gilt, ist eigentlich und vom Range r(8) =r(f). 


(3) Ist $ irgendeine meromorphe Abbildung aus %, so besitzt die holo- 
morphe Korrespondenz &:—= 4 | A wenigstens eine irreduzible Komponente 
a’, derart, dass r(a) = r($) und (A) =6 (A) = 4(X) ist. 

Beweis. Die Behauptungen (1) und (3) ergeben sich aus dem obigen 
Beweis zu Satz ILI.—Zu (2): Die Behauptung trifft jedenfalls zu, wenn der 
Raum X normal und die Abbildung f holomorph ist. Denn es ist dann 
f* | A: 4— > ¥* eine eigentliche surjektive meromorphe Abbildung (vgl. 

m m 


den 2. Absatz des Beweises zu Satz III); wegen f|A=ßA (f*| A) und 
m 


der Eigentlichkeit von f| A ist 8 nach Proposition 4.3.2 also eigentlich. 
Die Bildmenge 8(Y*) ist mithin eine analytische Menge der Dimension r($) 
in Y; da die r(f)-dimensionale analytische Menge (f| A) (A)—=f(X) in 
ß(X*) enthalten ist, gilt r(f) Sr(ß); wegen r(8) SdimY*==r(f) ist 
daher r(8) —=r(f). Auf diesen Sonderfall lässt sich der Allgemeinfall mittels 
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_ einer eigentlichen Modifikation (’X,r, X), derart, dass der komplexe Rauni: ’X 
normal und die Abbildung f: = f A+ holomorph ist zurückführen (vgl. den 
1. Absatz des Beweises zu Satz III): Der f-Klasse % entspricht vermöge r 
eine ’f-Klasse ’%, und die Abbildung *f*:==f* A r ist ’%-maximal ; wegen 
F=f At= (BAS) Ar =b A (Ar) BAT 
folgt also die Behauptung. 


Bemerkung. Es ist leicht zu zeigen, dass die in Satz III und da 
Zusätzen behaupteten Aussagen über f* nicht nur für eine spezielle sondem 
für jede %-maximale meromorphe Abbildung zutreffen. 

Eine Satz III. entsprechende Aussage gilt auch für “ meromorphe, Ab- 
bildungskeime” auf der analytischen Menge ACX (die jeweils’ durch 
meromorphe Abbildungen von Umgebungen von A repräsentiert werden; vol. 
oben Beispiel 3), p. 852). Wir begnügen uns damit, die Aussage hier nur 
anzugeben ; der Beweis lässt sich, mutatis mutandis, wie der Beweis zu Satz 
III führen. Ist f ein meromorpher Abbildungskeim auf A, so ist naheliegend, 
wie die Begriffe “ f-Klasse $ von meromorphen Abbildungskeimen ” und.“ $- 
maximaler meromorpher Abbildungskeim” zu definieren sind. 


Satz II. Sei f: X—>Y eine meromorphe Abbildung, ferner A eine 


“m 
irreduzible analytische Menge in X, die ein Fundamentalsystem irreduzibler 
offener Umgebungen in X besitzt. Die holomorphe Korrespondenz a: = f 14: 
Be besitze wenigstens eine irreduzible Komponente a’ Ars: die 


REN ist und für die r(a’)==r(f) gilt. Es sei f der durth, f repra- 
sentierte meromorphe Abbildungskeim auf A und 3 eine f-Klasse mero- 
morpher Abbildungskeime. Dann eristiert ein Ş-marimaler meromorpher 
Abbildungskeim. g 


Bemerkung. Die Forderung, dass die analytische Menge A ein Funda- 
mentalsystem irreduzibler offener Umgebungen besitzen soll, dient—ebenso 
wie die Voraussetzung der Irreduzibilität der Urbildräume meromorpher Ab- 
bildungen—lediglich zur Vereinfachung der Formulierung. —Es ist klar, oe 
sich Satz III leicht aus Satz ITI’ folgern lässt. 


5.6. Wir wollen den Spezialfall von Satz III bezw. Satz III’, in 
welchem die analytische Menge A nulldimensional ist, also aus genau einem 
Punkt besteht, besonders hervorheben. 

Ein Punkt z€ X heisst eine Unbestimmtheitsstelle k. Stufe der mero- 
morphen Abbildung f: X —> Y, wenn dim f(z) =k ist (nach 4.1 ist f(a») 


eine kompakte analytische Menge in Y; vermöge f: G[f]>Y ist z[f]* (20) 
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biholomorph auf f(z.) bezogen). x, heisst Unbestimmthettsstelle maximaler 
Stufe von f, wenn dimf(z,)=r(f) ist. 
Da für einen Punkt € X stets f | {to}: {x} —>Y eine eigentliche 
x 


holomorphe Korrespondenz und r(f | {z.}) = dim f(z) ist, folgt aus dem 

Zusatz (3) zu Satz III: Ist z, eine Unbestimmtheitsstelle maximaler Stufe 

von f, so ist f (£o) =f(X) (die analytische Menge f(x.) ist also insbesondere 

irreduzibel). Ist weiter fo: X —> Y, eine von f abhängige meromorphe Ab- 
m 


bildung, so ist z, auch Unbestimmtheitsstelle maximaler Stufe von fo. 
Aus Satz III bezw. Satz III’ ergibt sich nun 


Satz Ia. Seif: X—>Y eine meromorphe Abbildung mit einer Unbe- 


stimmtheitsstelle x, maximaler Stufe. Es sei % eine f-Klasse meromorpher 
Abbildungen. Dann existiert eine mit f analytisch verwandte -mazimale 
meromorphe Abbildung ff: <—>Y* auf einen r(f)-dimensionalen kom- 


pakten komplexen Raum Y*. 
Satz Ill’a. Seif: X——>Y eine meromorphe Abbildung mit einer Unbe- 
m 


stimmtheitsstelle x, maximaler Stufe; x, besitze ein Fundamentalsystem 
irreduzibler offener Umgebungen in X. Es sei F der durch f repräsentierte 
meromorphe Abbildungskeim in x, und % eine 7-Klasse meromorpher 
Abbildungskeime. Dann existiert ein $-marimaler meromorpher Abbildungs- 
keim. 


6. Abhängige meromorphe Abbildungen. 

6.1. Ein System © von I meromorphen Abbildungen f: X — Y, 
(A=1,:--,1) des irreduziblen komplexen Raumes X heisse N 
wenn kein fy konstant ist und r({fu* + - ‚fı}) =F h) gilt (für l= 1 ist 


{f1} := fi, die Rangbedingung also trivial). Ist das System nicht unabhängig, 
so nennen wir es schwach abhängig. © heisse abhängig im Falle l= 1, wenn 
fı konstant ist, und im Falle 7> 1, wenn es eine Anordnung fa,‘ + -, fy, der 
fa gibt, derart, dass fa, von der meromorphen Abbildung {fws °°, fara} 
abhängig ist (es ist dann 


SEEN): 


Offenbar ist © stets dann ein schwach abhängiges System, wenn es abhängig 
ist; das Umgekehrte gilt im allgemeinen nicht. Ist wenigstens eine der 
Abbildungen fi konstant, so ist & ein abhängiges System. 

Hine Bedingung für die Unabhängigkeit von © liefert 
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Proposition 6.1.1. Ist keine der meromorphen Abbildungen fy: 
X—Nn(=Ll::,1) konstant und existiert eine lokal-analytische Menge 


A m X, derart, dass die holomorphe Korrespondenz a: = {fu sfo | A: 
A——> YF, X: XY, den Rang Irch) hat, so bilden fu,’ - Sfi ein 
taekina System. = 

Denn es ist stets r({fi,° ° IDE Èr), und auf Grund der Voraus- 


setzung muss hier das Gleichheitszeichen gelten. 

Trifft für das System © der fy und die lokal-analytische Menge A C X 
die Voraussetzung von Proposition 6.1.1 zu, so nennen wir © auf A stark 
unabhängig. Besteht insbesondere A aus einem einzigen Punkt 2, so heisst 
© in x, stark unabhängig; x, ist dann notwendig eine Unbestimmtheitsstelle 
maximaler Stufe von {f,,---,f:}, und das gleiche gilt nach 5.6 auch für 
jedes f,, da fa von {fu > ,fi} abhängig ist. Ist B irgendeine nichtleere 
offene Menge in X, so ist klar, dass © genau dann ein unabhängiges System 
ist, wenn © auf B stark unabhängig ist. 

Das System © der meromorphen Abbildungen fi,‘ - -,f; heisse weiter 
B-unabhängig (“ Bildraum-unabhängig”), wenn kein fy konstant ist und das 
Bild von X unter der meromorphen Abbildung {f,,---,f;} nicht global 
analytisch dünn im Bildraum, d.h. dort in keiner analytischen Menge von 
positiver Codimension enthalten ist. Ist © nicht -®-unabhängig, so nennen 
wir © schwach B-abhangig. Die meromorphe Abbildung fo: X ——> Y, heisse 

m 


von der meromorphen Abbildung f: X ——> Y WB-abhängig, wenn die Bild- 
m 


menge {f, fo} (X) in einer analytischen Menge der Dimension r(f) enthalten 
ist. Das System © der Abbildungen fi,‘ > -,f; heisse schliesslich B-abhängig 
im Falle ¿== 1, wenn f, konstant ist, und im Falle 7> 1, wenn es eine 
Anordnung A, ',f, der fa gibt, derart, dass fi, von {fis Au} 
%-abhingig ist. 

Offenbar ist ein B-abhängiges System © stets auch schwach B-abhängig. 
Weiter gelten die folgenden einfachen Aussagen: 

(a) Set r(fx) = dim F} (Am1,---,1). Ist dann das System der fy 
unabhängig, so ist es auch B-unabhangig. 


Denn {fy- f} (X) enthält in diesem Falle eine lokal-unalytische 
t 

Menge der Dimension 2r (fx): Bezeichnet U die Menge der inbezug auf 
=1 


{fo + fi} nichtsingulären Punkte von X, so sei s€ U ein Punkt, in dem 
X irreduzibel ist und in dem der lokale Rang der holomorphen Abbildung 
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l 
{fat ,£} | U mit ihrem globalen Rang 2r) übereinstimmt; z, besitzt 
$ =1 
eine Umgebung V(X,), derart, dass {fu -*,fi}(V(2o)) eine lokal-ana- 
j i 
lytische Menge der Dimension 2r(h) ist (vgl. [22], Satz 19). Die Bild- 
=1 


menge {f1,: - * fi} (X) kann demnach in keiner analytischen Menge positiver 
Codimension enthalten sein. 

(b) Ist fy von f B-abhängig, so ist fu von f abhängig. 

Würde nämlich r({f, fo}) >r(f) gelten, so müsste {f, fo} (X) eine lokal- 
analytische Menge von einer r(f) übertreffenden Dimension enthalten (vgl. 
die Begründung zu (a)); {f, fo} (X) könnte daher nicht in einer- r(f)-di- 
mensionälen analytischen Menge enthalten sein, d.h. f, wäre von f nicht 
B-abhängig. 

(b’) Ist das System © der fy,: ',fi B-abhängig, so ist es auch 
abhängig. 

Dies ergibt sich sofort mittels (b). 

In besonderen Fällen lässt sich umgekehrt von der Abhängigkeit auf 
®B-Abhängigkeit schliessen. Die folgenden Propositionen betreffen solche Fälle. 


Proposition 6.1.2. Die meromorphe Abbildung fo: X ——> Y, set von 
m 
der meromorphen Abbildung f: X ——> Y abhängig. Es existiere eine irre- 


duzible analytische Menge A in X, derart, dass die holomorphe Korrespondenz 
a:=f | A: A—>Y eine irreduzible Komponente a’: A—>Y. besitzt, die 
k : k 


eigentlich ist und für die r(a’)—r(f) gilt. Dann ist f, von f auch B- 
abhängig. 
Beweis. Es sei % die Klasse aller von f abhängigen meromorphen abbil- 
dungen und f°: X —— Y* eine -maximale meromorphe Abbildung gemäss 
m 


Satz ITI. Man hat meromorphe Abbildungen 8: F*—>F und fo: P*—>Y, 
m m 


mit f =$ A f* und fo = £o A f*; nach Zusatz (2) zu Satz III ist 8 eigent- 
lich und vom Range r(8)=r(f). Es ist {f, fo} = {8 A f*, Bo A Fr} 
— {8,80} A f*, wie leicht mittels Proposition 3.4.2 folgt. Mit 8 ist {8, Bo} 
nach Proposition 4.3.1 eigentlich, ferner ist r({8,8,}) Zr(8) = dim Y* 
=r({B,Bo}), also r({B,Bo}) =r(B)—r(f). Demnach ist {8,0} (7*) 
eine r(f)-dimensionale analytische Menge in ¥ X Yo, und {f,fo}(X) ist in 
{8, Bo} (Y *) enthalten; f, ist daher von f B-abhängig. 

Ist der komplexe Raum X kompakt, so ist für A:— X die Voraussetzung 
über f in Proposition 6.1.2 stets trivialerweise erfüllt. Damit ergibt sich 
unmittelbar auch 


12 
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PROPOSITION 6.1.2a. Das System © der meromorphen Abbildungen 
fy: X—> Y, (A=1,--°+,1) sei abhängig; der komplexe Raum X sei 
kompakt. Dann ist © B-abhängig. 

Weiter folgt aus der Spezialisierung von Proposition 6.1.2 auf den 
Fall, dass die analytische Menge A einpunktig ist, sofort 


Proposition 6.1.2b. Das System © der meromorphen Abbildungen 
fx: X——> Y, Al: -,1) sei im Punkte z€ X stark unabhängig. Ist 


- dann fur: X—>YVus eine meromorphe Abbildung, die von der Abbildung 
m 


{no + +, fi} abhängig ist, so ist das System ©, der Abbildungen fi,‘ ` >, fo fi: 
B-abhängig. 


6.2. Es sei f: X—> F eine meromorphe Abbildung, % eine” f-Klasse 


von meromorphen Abbildungen. Enthält % die identische Abbildung von X, 
so nennen wir % eine [-Klasse auf X. % heisse ferner saturiert, wenn gilt: 
It 6X IE eine Abbildung aus % und y: Er eine _meromorphe 


Abbildung, derart, dass y Ag: X ->z definiert eu so gehört y A & stets 


zu %. Offenbar ist % genau dann BE I-Klasse und saturiert, wenn % 
jede meromorphe Abbildung von X enthält. 
Existiert eine %-maximale Abbildung f*: X De, Y*, so gibt es zu 


$: X == ‘Y aus Ẹ stets eine meromorphe Abbie 6: Y Toe 'Y, sodass 


$ ='ġ A f* gilt. Die so bestimmten Abbildungen ’& bilden, wie unmittel- 
bar ersichtlich, eine I-Klasse ’ auf Y*, welche vermöge der Zuordnung 
‘p—>’o Af*—=¢ bijektiv auf § bezogen ist. ’% ist genau dann saturiert, 
besteht also aus allen meromorphen Abbildungen von Y*, wenn % saturiert ist. 

Wir betrachten nun den Fall, dass f wie in Proposition 6.1.2 die 
Voraussetzung von Satz III erfüllt, dass also für eine irreduzible analytische 
Menge A C X die holomorphe Korrespondenz a:—f| A: ad Y eine irre- 
duzible eigentliche Komponente a’: A Er Y vom Range r(a’) =r(f) besitzt. 
Nach Satz III und seinem Zusatz (2) hat man dann eine $-maximale mero- 
morphe Abbildung ff: X—>Y*, derart, dass die meromorphe Abbildung 


ß: Tr für welche f= BAF* gilt, eigentlich und vom Range r(ß) 


=r (f) — dim F* ist. Es ist a’(A) —f(Z) ==: Y’ eine irreduzible r(f)- 
dimensionale analytische Menge in Y. Gleiches trifft für die Bildmenge 
B(Y*) zu; da F(X) = (8 A f*) (£) C B(f*(X)) =L *), ist f(X) = p(Y*). 
Bezeichnet fp’: Y*—> Y’ die Beschränkung von ß auf Y’, so ist 8’ eigent- 
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lich und vom Range r(g”) — dim F* = dim Y’; demnach ist (¥*,f’, F’) 
eine meromorphe Überlagerung von Y’.. Damit ist beweisen 


Proposırion 6.2.1. Sei f: X—— Y eine meromorphe Abbildung und 


% eine f-Klasse meromorpher Abbildungen. Es eatsttere eine irredusible 
analytische Menge A in X, derart, dass die holomorphe Korrespondenz 
a:==f|A: Ak eine irreduzible Komponente a’ ae besitzt, die 


eigentlich ine vom Range r(@) =r(f) ist. Dann ist f(x) = :Y’ eine 
irreduzible r(f)-dimensionale analytische Menge in Y, und es gibt eine 
meromorphe Überlagerung (Y*, 8’, Y’) von Y’, eine surjektive meromorphe 
Abbildung f*: > Y* sowie eine I-Klasse ree meromorpher Abbildungen 


von Y*, “sodass ER gilt: Durch die Zuordnung '#>’$ Af* (CES) 
wird eine bijektive Beziehung zwischen ’% und % gegeben; ’% besteht genau 
dann aus allen meromorphen Abbildungen von Y*, wenn % saturiert ist. Die 
Abbildung f* ist B-mazimal. 


6.3. Wir interpretieren in diesem Abschnitt die Aussagen über 
Abhängigkeit meromorpher Abbildungen für den Spezialfall meromorpher 
Funktionen. l 

Sei X ein irreduzibler komplexer Raum. Unter einer meromorphen 
Funktion auf X wird eine meromorphe Abbildung ¢: X re in die 


Riemannsche Zahlenkugel P+ verstanden, die X nicht konat in den Punkt 

œ von P? überführt: (Zur Bezeichnung: P' wird identifiziert mit dem 

komplex-projektiven Raum der homogenen komplexen Zahlenpaare (to, ta); 

es ist œ= { (0, u) } (u 540), PP—-{o}—C, PO: = Pt X: + -X PR). —Die 
\ J 


l l E l 

Verknüpfungen meromorpher Funktionen lassen sich wie folgt erklären: Es 
gibt meromorphe Abbildungen 4 (i=1,- --,4) von P in P*, durch die 
die Addition bezw. Subtraktion bezw. Multiplikation bezw. Division kom- 
plexer Zahlen beschrieben wird (ist (2, y) €C? C PO, so ist z. B. v (z,y) 
=a-+y€C CP). Sind nun 4, ġa meromorphe Funktionen auf X, so sind 
Summe, Differenz, Produkt und, falls & nicht konstant gleich Null ist, 
Quotient von $, und $, jeweils durch v; A {¢:,¢2} mit dem entsprechenden 
v; definiert. 


Es gilt: 
(1) ‚Sei f:X—>Y eine meromorphe Abbildung. Dann bildet die 


Menge der von f abhängigen meromorphen Funktionen auf X einen Körper 
MAX). 
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. Ist speziell :: X>X die en Abbildung, so schreiben wir M,(X) 
=: MX). z z 
(1) Se ACX eine irredusible opidi Menge, die en Funda- 
mentalsystem von offenen irreduziblen Umgebungen in X besitzt. Set f: 
X Zr eine meromorphe Abbildung und f der durch f repräsentierte 


meromorphe Abbildungskeim auf A. Dann bildet die Menge der von f 
abhängigen meromorphen Funktionskeime auf A einen Körper M; (A, X). 
Ein System von | meromorphen Funktionen a: X —> P! (A=1,:-.:,1) 
"n 


heisst algebraisch abhängig, wenn es eine durch ein nichtkonstantes Polynom 
bestimmte om Abbildung ®: PR gibt, sodass 


PA {tu soi}: xp 


die: konstante Abbildung ist, die X in den Nullpunkt des P* überführt. 

(Es ist klar, dass jedes Polynom F(z,,' - ",2) eine meromorphe Abbildung 

& von P“) in Pt bestimmt; für jeden Punkt g€ X, der nicht Unbestimmtheits- 

stelle oder Pol eines ¢) ist, ist A {du . si) (a) eh: . AR): 
Wir stellen nun fest — 


(2) Für ein System meromorpher Funktionin sind die Begriffe 
“schwach B-abhängig” und “ algebraisch abhängig” äquivalent. 
Denn ist das System © der meromorphen Funktionen da: X—>P? 
hi m 


A= 1,: -, 1) algebraisch abhängig, ist also & A {du - <, pı} (X) = {0} € Pt 
(® hat die oben angegebene Bedeutung), so muss {$1,° * <, $} (X) in der 
1-codimensionalen analytischen Menge ©7(0) enthalten sein; © ist mithin 
schwach ®-abhängig. Ist umgekehrt © schwach ®-abhängig, so heisst dies, 
dass {d,° * *,¢:}(X) in einer mindestens 1-codimensionalen analytischen 
Menge A in P® enthalten ist. Nach W. L. Chow [9] ist eine solche Menge 
A stets Nena also gibt es eine durch ein nichtkonstantes Polynom 
F(a," + +,21)° bestimmte meromorphe Abbildung ®: PO —> Pr, sodass 
BA {pu't (X) = {0} € P* gilt. 

‘Aus den Proposition 6. 1. 2a und 6.1. 2b ergeben sich daher die folgenden 
Sätze von W. Thimm [34, 35, 86, 87] : . . 


` (a) Auf einem kompakten komplexen Raum ği ein System RENTEN 
meromorpher Funktionen stets algebraisch abhängig. 


-(b) Das System © der auf dem komplexen Raum X meromorphen 
Funktionen ¢1,: + +,¢1 set im Punkte mE X stark unabhängig. Ist dann 
dur eine auf X meromorphe Funktion, derart, dass das System ©, der Funk- 
tionen di," ` "du oui abhängig ist, so ist ©, algebraisch abhängig. ` 


MAXIMALE HOLOMORPHE UND MEROMORPHE ABBILDUNGEN, II. 865 


Damit (b) aus Proposition 6.1.2b gefolgert werden kann, muss nur 
gezeigt werden, dass aus der Voraussetzung “©, ist ein abhängiges System” 
hier “$u ist von {¢1,- ' ",$1} abhängig” folgt. Für konstantes m, ist 
dies klar. Ist $,,, nicht konstant, also r (nı) =]1, so hat man 


r({bs,° + +> ¢:}) Sr({br° + +, ¢u1}) 
ri Erlen hr) +r(64:) 
= (gr) be (gr) FL I+ 
Würde r({¢1,° * :,¢u1}) =1 + 1 gelten, so wäre ©, ein unabhängiges System; 
:, demnach ist r({{¢1,° - +, 2}, $u1}) =r({du' -+,;¢:}) und folglich $,. von 
EC’ 5 * sr} abhängig. ` å 
Sernun f: X ae Y eine ‘meromorphe Abbildung: zu der eine komplexe 


m-Basis (f*, ¥*) stehen, Ea bezeichne % die Klasse aller von f abhängigen 
meromorphen Abbildungen, ferner “ die Klasse aller meromorphen Ab- ` 
bildungen von F*. Nach 6.2 wird durch die Zuordnung #>’$A f* 
('bE’%) eine bijektive Beziehung zwischen ’ und % hergestellt. Es ist 
_ klar, dass hierdurch insbesondere ein Isomorphismus des Körpers M(Y*) 
auf den Körper M,(X) induziert wird. 
Es werde jetzt über f weiter vorausgesetzt, dass die Bildmenge f(X) =: Y” 
eine (irreduzible) analytische Menge in Y ist, ferner, dass die zur Beschrän- 
kung Pf: X = Y’ von f auf Y’ gehörige meromorphe Abbildung g: ` 


Y ars F’, für welche f’ == 8° A f* gilt, eine meromorphe Uberlagerungsab- 


iig ist (dies tritt insbesoridere ein, wenn f wie in Proposition 6.2.1 die 
Voraussetzung von Satz IIT erfüllt). Es gilt dann 


(3) Der Funktionenkörper M(¥*)—also auch der Körper Ut,(X)— 
‚ist zu einer endlichen algebraischen U des Körpers M(Y”) 
_, isomorph. 

- Dies kann auf folgende Art nachgewiesen werden: Durch >’ AP’ 
(HEM(T’)) wird ein Monomorphismus *f’: M(F’)>M(T*) gegeben; 
M(Y’) ist daher zu dem Unterkörper *#(WM(Y‘)) von M(Y*) isomorph. 
Jede Funktion y*€ M(Y*) genügt einer Gleichung ` 

Pete te, 
wo b die Blätterzahl der meromorphen Überlagerung (Y*, BY Y’) bezeichnet 
und $:*,: ` *,$,* Funktionen aus *#(M(Y?)) sind (d1%,° > +, $o” sind die 
nen Funktionen der “Zweige” von y* über Y’); also 
ist M(P*) endlich algebraisch über FFr/(M(T’)). 

Ein wichtiger Spezialfall liegt vor, wenn ¥Y’ =Y—=P© ist. Dann ist 
M(E) = M (PO) isomorph zum Körper C(z,,- - -,%:) der rationalen Funk- ` 
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tionen von } komplexen Veränderlichen 2,---,2:; also sind M(Y*) ‘und 

M,(X) zu einer endlichen algebraischen Erweiterung von €(21,- ' -,%) 

isomorph. Dieser Fall tritt z.B. ein, wenn X kompakt ist und f: X —P® 
m 


gegeben wird durch Z meromorphe Funktionen ¢,,- - -,¢; die ein maximales . 
unabhängiges System meromorpher Funktionen auf X bilden (d.h. es ist 
f— {¢:,' > soi}, wobei das System der ¢,,- - -,¢; unabhängig, für jede 
weitere meromorphe Funktion ¢ auf X das System der ¢:,: * -,¢1,¢ jedoch 
abhängig ist). Damit haben wir den te 

Sartz von CHow-THrum."* Der Körper der auf einem irreduziblen 
kompakten komplexen Raum meromorphen Funktionen ist isomorph zu einer 
endlichen algebraischen ERS eines rationalen Funktionenkörpers 
über C. 

Wird nur vorausgesetzt, dass Y* Koma ist, 80 bt sich weiter, dass 
M(X) auch in diesem Falle zu einer endlichen .algebraischen Erweiterung 
eines rationalen Funktionenkörpers über C isomorph ist. Der komplexe 
Raum Y* ist z.B. dann.kompakt, wenn f eine Unbestimmtheitastelle ‚maxi- 
maler Stufe besitzt. Folglich güt: 


PROPOSITION 6.3.1. Sei f: X-—>Y eine meromorphe a mit 
m 


einer Unbestimmtheitsstelle z,€ X masimaler Stufe. Dann ist der Körper - 
der von f abhängigen meromorphen Funktionen auf X isomorph zu einer 
endlichen algebraischen Erweiterung eines rationalen EN 
über C. 

Für den Fall, dass Y =P® und r(f)—1 ist (d.h. wenn f Such ein 
in % stark unabhängiges System von 1 meromorphen Funktionen gegeben 
wird), ergibt sich ein bekannter Satz von W. Thimm [84,36].. Dieser Satz 
und der Satz von Chow-Thimm wurden auch von R. Remmert [24] durch 
Spezialisierung einer allgemeineren Aussage, über abhängige meromorphe 
Funktionen, gewonnen. 

Eine der Proposition 6.3.1 entsprechende Aussage, die analog abzuleiten 
ist, gilt auch für meromorphe Funktionskeime (vgl. auch hierzu [24]) : 


PROPOSITION 6.3.1’. Set f: X—>Y eine meromorphe Abbildung mit 
einer Unbestimmtheitsstelle z€ X maximaler Stufe; x, besitze ein Funda- 
mentalsystem irreduzibler offener Umgebungen in X. Es sei f der durch f 


repräsentierte meromorphe Abbildungskeim in x. Dann ist der Körper der 
von -f abhängigen meromorphen Funktioneskeime in t, isomorph zu einer 


13 Vgl. [98,37]. Ein einfacher Beweis des Satzes wurde von R. Remmert in [21] 
gegeben; dort finden sich auch Hinweise auf weitere Literatur. 
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endlichen algebraischen rang eines rationalen Funktionenkörpers 
über C. 
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ON THE ALGEBRA OF REPRESENTATIVE FUNCTIONS OF AN 
ANALYTIC GROUP, II. 


By G. Hocasommp and G. D. Mostow.* 


1. Introduction. We continue our study [1] of the algebra R(@) of 
the representative functions of an analytic group G. In particular, we employ 
R(Q) for investigating the algebraic hulls of @. For the usual algebraic- 
geomejyic reasons, we confine our attention to complex analytic groups. 

The algebraic hulls of G are viewed as the groups of all proper auto- 
morphisms of finitely generated fully stable subalgebras of R(@) separating 
the points of @. One of our results (Th. 3.1) is that the structure of an 
algebraic hull and the location of @ in it are particularly transparent when 
the corresponding subalgebra of R(@) contains a normal basic subalgebra. 
Conversely, certain comparatively mild regularity requirements on an algebraic 
hull imply that the corresponding subalgebra of R(G@) contains a normal 
basic subalgebra (Th. 4.1) or, equivalently, that the algebraic hull “ domi- 
nates,” by a rational’ epimorphism, a “nuclear” algebraic hull A(G,K) 
associated in a natural way with every nucleus K of G. 

The nuclear algebraic hulls are shown to be the solution of a certain. 
universal problem concerning analytic homomorphisms of @ into algebraic 
linear groups whose restrictions to the given nucleus K satisfy a compatibility 
condition with respect to the adjoint representation of K (Th. 5.3). The 
structure of the nuclear algebraic hulls A(G,K) and of the corresponding 
subalgebras of R(@) is analyzed in detail. 


2. Auxiliary representation theory. We assemble a few results of 
representation theory for later use. The first of these is a generalization of 
the usual weight space N of a a space for a nil- 
potent Lie algebra. 

Let L be a finite- ne solvable Lie algebra over an algebraically 
closed field F of characteristic 0. Let p be a representation of L. by linear 
endomorphismsof a finite-dimensional F-space V, and let p’ denote the semi- 
simple representation of L that is associated with p. Then p’ is a direct sum 
of 1-dimensional representations, which may be regarded as Lie algebra 
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homomorphism L—> F. We denote by P (p) the finite set of these Lie algebra 
homomorphisms. Let « stand for the adjoint representation of L. We 
partition the set P (p) into equivalence classes, calling two elements k, and hs 
of P(p) equivalent if hı — h: belongs to the additive group of Lie algebra 
homomorphisms L—> F that is generated by P (a). 

If h is any Lie algebra homomorphism L— F and z is an element of L 
we denote by pa(x) the linear endomorphism of V that is defined by p(z) (v) 
= p(z)(v)—h(z)v. If y is an equivalence class of elements of P(p) ‘we 
denote by Vy the set of all elements v of V for which there exist elements 
hay’ in in y such that py,(t1)---pa(tn)(v) =O for all n-tuples 
| (Zu +, @n) of elements of L. One verifies immediately that each, Me is 

an L-stable subspace of V. l 


Lemma 2.1. In the notation introduced above, V is the direct sum of 
the L-stable subspaces Vy, where y ranges over the equivalence classes of 
elements of P(p). 


Proof. We may evidently choose an element z in L such that the values 
h(a), as h ranges over the finite set ((0) U P(p)) + ((0) U P(a)), are all 
distinct. If e is any linear endomorphism of V and a is an element of F 
we denote by V,(e) the subspace of V consisting of all elements that are 
annihilated by some power of e—.al, where I stands for the identity map 
‚on V. We claim that if V.(p(z))'is not (0) then a€ P(p) (z), ie. » Gam h (2) 
with some A in P(p). Indeed, our assumption implies that there is a non- 
zero element v in V such that p(x) (v) =av. On the other hand, it is clear 
from the definition of P(p) that there are elements hı, - -,h, in P(p) such 
that pr (2) - -pm (2) (0) —=0- This given (a—Iy(2)) + - (a—hia(2))o0 
== 0, so that we must have a == h(x) for at least one of the indices i. 

Since V is evidently the sum of the subspaces V,(p(z)), we have 


therefore V = >) Va(p(x)). Similarly, L= © L,(a(r)). If y is 
a € P(p)(a) se P(X) (a) 
any equivalence class of elements of P(p) we put Wy= 3 Va(p(z)). It is 
aey(e) 


clear from the above that V is the sum of the subspaces Wy. Moreover, this 
sum is evidently a direct sum. Hence it will suffice to show that W, = Vy 
for each y. 

For this purpose, we show first that Wy is L-stable. By the Aver 


decomposition of L, it will suffice to show that p(y)(Wy) C Wy if y € Ly(a(z)) 
with b in P(a)(r). Now we have 


(p(x) —a)p(y) =p([2,¥]) + p(y) (p(2) —al), 
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whence 


(p(t) — (a+ b) p(y) == p((a(z) IN (y)) + p(y) (p (2) —af). 


Hence we obtain, by induction on n, 
(Pte) — (+9) Dt) =È (Gel (a(z) ED) (P(e) —al)™, 


which shows that p(y)(Va(p(z) )) C Vase(p(x))« Now suppose that a—h(z), 
with h in y, and b = k(x), with k in P(a). I£ Vaw(p(z)) A (0) then we 
must have a+b == t(s), with ¢ in P(p). By the choice of z, it follows that 
h+k==t€P(p), so that h+key and a+bey(z). Thus we conclude 
from dur above result that p(y) (Wy) C Wy, and so we have shown that Wy 
is L-stable. 

Let pY denote the representation of L on Vy that is induced by p. Then 
we have P(p%) C y and hence 

Vy= 3% (Vy)a(p?(z)) C E Valp(t)) = Wy. 
a € P(p7)(a) scr(e) 

Now consider the factor module W,/Vy. If this were not (0) it would 
contain a 1-dimensional Z-stable subspace Fu, say. Then we have, for every 
element y of L, y-u==h(y)u, where h belongs to P(p). On the other hand, 
if v is a representative of u in Wy, there are elements hu,’ * >, ha in y (not 
necessarily distinct) such that pn, (2) > "pn, (z) (v)=0. If we pass over to 
W./Vy we obtain from this that (h(x) —hi(z))+ - - (h(z) —hun(2))u=0, 
whence h(x) ==h;(z) for some index i. By the choice of v, this implies that 
h=h&y. Since p(y)(v) —h(y)ve Vy for every element y of L, this 
„gives v € Vy, whence the contradiction u ==0. Thus we must have Vy = Wy, 
and Lemma 2.1 is proved. 


CoROLLARY 2.1. Let G be a solvable complex analytic group, and let o 
be a complex analytic representation of G by linear automorphisms of a finite- 
dimenstonal complex vector space V. Then the analogue of Lemma 2.1 holds 
for ©. i 


Proof. Let P(o) denote the set of complex analytic homomorphisms 
G— C* that is determined by the semisimple representation associated with - 
o, where C™ denotes the multiplicative -group of the non-zero complex numbers, 
If ¢ is any complex analytic representation of G denote by ¢ the differential 
of &, i.e., the induced representation of the Lie algebra G of G. Then the 
map that sends each ¢ onto ¢' is evidently a bijective map of P(o) onto P(c’). 


872 G. HOCHSOHILD AND G. D. MOSTOW. 


Let £ be the adjoint representation of G. Then it is clear that two elements 


of P(o) are equivalent mod. P(g) if and only if their differentials are equi- _ ; 


- valent mod. P(g’). Our corollary will therefore follow from Lemma 2.1, 
applied to o’, as soon as we have shown. that, for each equivalence class § of 
elements of P(o), we have V= Vz. f 
Let q be any complex analytic homomorphism G- 0O* and let r be any 

finite-dimensional complex analytic representation of G. We claim that the | 
-endomorphisms r(u) —g(u)T are 0 for-all elements u of G if and only if 
the endomorphisms r(x) —q(z)I are 0 for all elements z of Œ. In fact, the 
first condition means that the representation rg defined by r,(%) == q (u)r (u) 
is trivial, which is the case if and only if its differential is trivial. Since 
(Ta) (2) =r (x) — g (2)I for every element 2 of Œ, our claim is established. 
This enables us to show, by means of an evident indudtiye procedure, that 
we have indeed Vs = Va. 
u Let @ be a group, F a field. We say that an F-algebra A.of F-valned 

representative functions on @ is fully stable if it is stable under the left 
and right translations as well ag under the involution g—>g’, where g'(x) $ 
== g(a). We shall require the following elementary representation theoretical 
lemma, which is not new, but is included here for the convenience of the 
‚reader. 


Lemma 2.2. Let F-be an arbitrary field, @ a group. Let A be a fully 
‘stable F-algebra of F-valued representative functions on G, and let V be.any 
non-zero left G-submodule of A. Then the constant function on G with value, 
1 belongs to the ideal of A that is m by V. 


Proof. Without loss of ioniy, we may assume that V is simple as 
a left G-module. Then the dual G-module V* is also simple. The stability 
assumption on A implies that the representative functions associated with V* 
belong to A. -Now V* is isomorphic with a G-submodule of the direct sum 
of a finite number of copies of the G-module constituted by the representative 
functions associated with V*. Since: V* is. simple, this implies that there 
is a G-module monomorphism ¢: V*— A. ~ 

Now let (v,° *:,v) be an F-basis of V such that »,(1)—1 and 
%(1) =0 for all the other indices i, Let Crs: ` +,Ys) be the dual basis’ 


‘of V*, For x in Q, write a T: n= 3 f(t) Then we have (2: yx) (%) 


ge ) —fu(r?), so that z: “ym Sf) 
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Now put a,—¢(yx)€A. Choose y in GŒ such that a,(y) 0. For 


every z in G, we have 2 y= S fyl )a y. Hence 
j=i 
n n ; 
T(E (dey) ve) = fas (2*) (ay) fea (2) 02 =D (Gey) Oe 
kel 4st ri 


Thus the function > (ax y)vr is constant and, by evaluating it at 1, we find 
that its value is Pe (y) #0. Hence the constant function with value 1 is 
equal to ESS (ayy) v,, Which evidently belongs to the ideal of A that 
is generated by 2 This completes the proof of Lemma 2.2. 


3. Regular subalgebras. Let @ be a complex analytic group, and 
denote by R(@) the algebra of all analytic representative functions on G. We 
shall assume throughout that R(@) separates the points of G. A subalgebra 
of R(G) will be called a regular subalgebra if it is fully stable and finitely 
generated as a C-algebra and contains a normal basic subalgebra of R(@). 
As usual, we put Q =exp(Hom(@,C)), where Hom(@,@) stands for the 
group of all analytic homorphisms of @ into the additive group C of the 
complex number field. ` 


Lemma 3.1. Let S be a regular subalgebra of.R(@), and let B bea 
normal basic subalgebra of R(G) that is contained in 8. Then 8 = B[S NQ]. 


Proof. Every non-zero element of 8 can be written in one and only one 


n 
way as a sum „big, where the bs are non-zero elements of B and the grs 
fa 


are distinct elements of Q. Our lemma amounts to the statement that then 
each q; belongs to S. Suppose this is false, and consider non-zero elements 
of $ in which none of the q,’s belongs to S. Among these, take one in which 
n is minimal. Let N denote the radial of the commutator subgroup of G, 
and recall that every complex analytic representation of @ induces a unipotent 
representation of N and that, for every element x of N and every element q 
of Q, we have z: q =q. By applying a finite sequence of left operations s — 1, 


n 
with z in N, to our element of $ in succession, we obtain an element $ aq 
4-1 


of S in which each c; belongs to the N-fixed subalgebra BY of B and, because 
of the minimality of n, is different from 0. By [1, Lemma 4.1], we have 
BN == 2(G)*[Hom(G,C)], where K is the nucleus of @ that is associated 
with B. In particular, this shows that BY is stable under both the left and 
the right translations. 
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‚Now let 2 J an element of G. Translating our element of S from the 
left by z and multiplying by ¢,, we obtain 


E (z oa(eagne 8. 
1 
On the other hand, multiplying our element of 8 by (-¢:)q:(z), we obtain. 


X(t: a)a(eage 8. 
1 es 
Subtracting and using the minimality of n, we find that, for each i, 


(2: c1)gi (2) ome (2° un 
Thus, for every element y of G, 


ca (ys)q(s)aly) = alyz) g(r) (y). 


Hence we have o(y) (c1: y)gı = c (y) (a'y)qe Here, the coefficients of g, 
and q, are element of BY. Since the elements of Q are free over B, it follows 
that we must have «(y)(cı‘y) =0 whenever 1341. Choosing y so that 
G(y)cı(y) 0, we obtain a contradiction from this by evaluating at 1, 
except in the case where n—1. Thus we must have n—=1 and oq, € 9. 

Now let V be the left G-submodule of S that is generated by cıqı. Then 
we have VC 8qi, and it follows from Lemma 2.2 that there is an element 
sin 8 such that sq, 1. Hence q*=s ES. Since 8 is stable under the 
involution ff, this gives g,€9, contrary to our assumptions. Thus 
S=B[SN Q]. 


Lemma 3.2. Let S be any fully stable subalgebra of R(@) separating 
the points of G. Then 8 contains the representative functions associated 
with the adjoint representation of G. 


Proof. Without loss of gonerality, we may assume that s is finitely 
generated. 


Let As denote the group of all proper automorphisms of 9, and recall 
the following standard facts. Ag is an algebraic linear group, representable 
as such on any left translation stable finite-dimensional generating subspace 
of S. If we associate with an element s of S the function s* on Ag defined 
by s*(a) ==a(s)(1) then the map s—s* is an isomorphism of S onto the 
, algebra of all rational representative functions on As, because S is fully 
stable. The group Gg of the left translations of § is a normal analytic sub- 
group of Ag, and Gg is algebraically dense in As. Since S separates the 
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points of G, we may identify G with Gg by the map that assoriates with each 
element of @ the left translation it effects on S.. When this is done, every 
element s of 8 becomes identified with the restriction of s* to Gs. Since Gg 
is a normal analytic subgroup of Ag, the Lie algebra of Gg is an ideal of the 
Lie algebra of As. Now the adjoint representation of Ag is a rational 
representation, and the adjoint representation of @ is the restriction to 
Gg of the adjoint representation of Ag on the Lie algebra of Gg. Hence 
the representative functions associated with the adjoint representation of G 
are the restrictions to Gg of rational representative functions on Ag and 
therefore belong to S. This completes the proof of Lemma 3.2. 


TEEoREM 3.1. Let 8 be a regular subalgebra of R(@), and let M be 
a maximal fully reducible subgroup of the algebraic group Ag of all proper 
automorphisms of 8. Let Gg be the canonical image of Gin Ag. Then Gs 
is an algebraically dense and topologically closed normal -analytic subgroup 
of Ag, and MN Gz is an algebraic subgroup of M and a maximal reductive - 
analytic subgroup of Gg. There is an algebraic subgroup X of M such that 
M ts the direct product X X (M N Ga), in the sense of algebraic groups, and 
Ag is the semidirect product X ; Qg, in the sense of complex analytic groups. 
_ Moreover, the algebraic group X is isomorphic with (C*)®, where C* denotes 
the multiplicative group of the non-zero complex numbers and d is the rank 
of the finitely generated free abelian group SN Q. 


Proof. Since 8 is finitely generated as a C-algebra, we see immediately 
from Lemma 3.1 that S N Q is finitely generated as a group. Since the group 
Q has no elements of finite order, it follows that 3 N Q is a finitely generated 
free abelian group. Hence the group Hom($N Q, C*) of all homomorphisms 
of ENQ into C* is isomorphic with (C*)* by an isomorphism obtained 
in the evident fashion from a basis of SNQ. Accordingly, we regard 
Hom($NQ,0*) as a complex analytic group or also as an algebraic group. 

Let «€ Ag, ge 8NQ, f€ Hom(G,C). Then we have a(q) =a (q)q, 

with o/(q) € C*, and a(f) =f +o (f), with a(f)€C. Let fy be the unique 
` element of Hom(G,(C) such that exp(f,) =g. We define an element a* of 
Hom(S N Q, 0%) by setting a*(q) = «’(g)exp(— a (fa) ), for every element 
g of SNQ. Then one sees immediately that the map «> a* is a complex 
analytic homomorphism of Ag into Hom (8 MQ, C*), and that Gy lies in the 
kernel of this homomorphism. zZ 

Now let B be a normal basic subalgebra of R(@) that is contained in 8, 
and let B’ denote the image of B under the involution f>f. Since 


876 . G. HOOHSOHILD AND G. D. MOSTOW. 


8 = BŪS N Q], by Lemma 3.1, we have alsó S=BISn Q]. On the other 
- hand, B[Q]—R(G@). We recall also that B’, like B, contains Hom (G, C), 
and that B’ is stable under the right translations. 


Let « be an element of Ag such that «ë 1. It is clear from what: ‚we 


have just seen that there is a proper automorphism £ of R(G) such that B 
. coincides with a on B’, while 8(q) =exp(«’(f,))g, for every element q of Q. 


_ By. this very definition, 8 is a perfect automorphism of R(@) and hence 
is the left translation effected by an element of G. Since a*—1 and. >. 

S==B’[SOQ], it is clear that 8 actually coincides with a on 8, so -that 
. «€ Gs. Thus Gg is precisely the kernel of our homomorphism a— a*, and 


is. therefore a closed normal subgroup of As. 


Now let X be the subgroup of Ag consisting of tha ins that ``; 
leave the elements of B’ fixed. Then X is evidently an algebraic subgroup 


of As. We have XNG@s— (1), because an automorphism that leaves the 
. elements of B’ fixed leaves the elements of Hom(@,@) fixed so that, if it 
belongs to Gg, it leaves the elements of SQ fixed. ` i 


Now let '& be any element of Hom(8 NQ, C*). Then we may define 


an element a of As by demanding that « be the identity on B’ and: that 


alq) =$(q)q for every element q of SNQ. Then a€X and a* = ġ. 
Thus our homomorphism «— «* maps X isomorphically onto Hom(S N Q; C*). 
Moreover, it is clear from thè definition that the restriction of the homo- 
morphism ¢->a* to X is a rational homomorphism. Thus X is isomorphic 
with (C*)4, in the sense of algebraic groups. Since we have evidently 


Ag==X Gs, we have proved that Ag is the semidirect product X-@s, in the. 


sense of complex analytic groups. It is a standard known result that Gs iş 
algebraically dense in Ag. 
Let K be the nucleus of @ that is associated with the normal basic 
subalgebra B. By [1, Theorem 4.1], there is an element v in @ such that 
B- is the normal basic subalgebra that is constructed in the standard 
fashion [1, pp. 114-115] from a semidirect product decomposition G=H-K, 
where H is a closed reductive analytic subgroup of G. Replacing B by B-a, 
. .if necessary, we may therefore take B to be such a standard normal basic 
` subalgebra. It is evident from the standard construction [1, pp. 114-115] 
that then B is stable under the right translations with the elements of H, 


whence B’ is stable under the left translations with the elements of H, ie, | 


B’ is stable with respect to Hg. Moreover, the left translations with the 
elements of H leave the elements of Q fixed, so that the elements of S N Q are 
Hg-fixed. Hence it is evident that the elements of X commute with the 


eag 
.r 
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elements of Hs. Since H is reductive, Hg is a fully reducible algebraic sub- 
group of Ag. Since X and Hg commute element-wise and since X N Hg == (1), 
the group generated by X and Hg is the direct product X X Hs, and it is 
clearly a fully reducible algebraic subgroup of Ag (noting that a subgroup 
generated by algebraic subgroups is an algebraic subgroup). 


Let Y be a fully reducible subgroup of Ag containing X X Hs. Then 

Y = (X X Hs)}(XY OKs). Let y be an element of Y and let k be an 
element of Ks. Then yky*k lies in the commutator subgroup of Ag, which 
_ coincides with the commutator subgroup of Gs. The analytic subgroup Kg 
_ of Ag is normal in Gg. Since Gs is algebraically dense in Ag, the considera- 
tion of the adjoint representation of Ag shows immediately that Kg is normal 
also in Ag. In particular, Y N Ks is a normal subgroup of Y and is 
therefore fully reducible. Now consider the representation of YM Kg on 
C-+Hom(@,0). On the one hand, this is evidently a unipotent representa- 
tion. On the other hand, since Y N Kg is fully reducible, this representation 
is semisimple. Hence Y N Kg leaves the elements of Hom(G,C) fixed. Let 
Ng denote the radical of the commutator subgroup of Gs. The kernel of the 
representation of Kg on C+ Hom(G,C) is known to be Ns. We may 
therefore conclude that YM Kg C Ng. But Ng isa unipotent subgroup of As. 
Hence Y N Kg = (1), and we have shown that Y == X X Hs. Thus X X Hs 
is a maximal fully reducible subgroup of As. It is known, but follows also 
from the above argument, that Hg is a maximal reductive analytic subgroup 
of Gg. Finally, since any two maximal fully reducible subgroups of Ag are 
conjugate by an inner automorphism, it is clear that.the conclusions of 
Theorem 3.1 hold for every maximal fully reducible subgroup M, provided 
that they hold for one of them. The proof of Theorem 3.1 is now complete. 


4. Regular algebraic hulls, By an algebraic hull of the complex 
analytic group @ we shall mean an analytic monomorphism p of @ into an 
algebraic linear group L such that p(G@) is algebraically dense in L.. Such 
an algebraic hull p: @— L will be called a regular algebraic hull if it satisfies 
the following two requirements: (1) for every analytic homomorphism fof G . 
into C there is a rational homomorphism f°: L—>C such that f?op—=f3 

à (2) there is a rational endomorphism ¢ of L such that g6o¢=—¢ and ¢(L) 
= is a maximal reductive analytie subgroup of p(@). 

It is clear from Theorem 3.1 that if 8 is any regular subalgebra of 

R(G) then the canonical map G-> Ag is a regular algebraic hull; the above 
| ‘requirement (1) is satisfied because Hom(G, C) is contained in S&S. We wish 
} to prove the converse of this result. . 


13 
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TEROREM 4.1. Every regular algebraic hull of G can be identified with 
an algebraic hull G— As, where 8 is a regular subalgebra of R(G). 


Proof. Let p: @>L be a regular algebraic hull of G. If P(L) 
denotes the algebra of all rational representative functions on L then P(L) op 
is a subalgebra of R(G). Since p(G@) is algebraically dense in L, the map 
f>for of P(L) onto P(L) op is an isomorphism. Thus we may identify 
P(L) with a fully stable subalgebra S of R(G), and we may identify L with 
the group Ag of all proper automorphism of 9, whereby p is transported into 
the canonical map G->Ag. What we have to prove amounts simply to the 
result that S is a regular subalgebra of R(@). 


By condition (2), we have (Ag) = Hg, where H is a maximal reductive 
analytic subgroup of G. Now Hs is a fully reducible subgroup of As and is 
therefore contained in a maximal fully reducible subgroup M of Ag. Let K 
be any nucleus of G. Then G is the semidirect product H:K. Hence Gg is 
the semidirect product Hg- Ks, and MN Gs =Hs(M N Ks). By condition 
(1), we have Hom(G,C) C8. . Hence we see exactly as in our proof of 
Theorem 3.1 (where we showed that Y N Ks= (1)) that M N Kg== (1), 
so that MN Ga = Hs. . 


We know from [1, p. 123] that Ag is the semidirect product M- Us, 
where U is the unipotent hull of @. Since ¢ is a rational homomorphism, 
(Us) is a unipotent normal subgroup of Hs. Since Hg is fully reducible, 
it follows that ¢(Us) = (1), whence Hgs==¢(MĦ). Since go¢— 4, it is 
clear that M is the semidirect product X-Hg, where X is the kernel of the 
restriction of ¢ to M. On the other hand, the commutator subgroup of M 
lies in M N Gs==Hs. Hence M is actually the direct product X X Hg, and 
X is abelian. We have the decomposition As = (X X Hg):Us. Since X: Us 
is contained in the kernel of &, this shows that X Ug actually coincides with 
the kernel of ¢. Since X is abelian, it is clear that X- Ug is solvable. 

Now let V denote the kernel of pop. Then Vg==p(V) is the kernel 
of the restriction of ¢ to Gg, i.e, Vg—=(X-Ug) N Gg. Since the restriction 
of @ to Gg is a projection homomorphism of Gy onto Hyg, it is clear that Gs > 
is the semidirect product Vs-Hg. In particular, Vg is therefore a closed 
normal complex analytic subgroup of Gg. Since Vg is contained in the 





solvable complex analytic group X Us, we conclude that Vg is solvable. k 


Moreover, Vg is homeomorphic with the homogeneous space Gs/Hs and is 


therefore simply connected. Thus Vg is a nucleus of Gs, and so V is a 
nucleus of Q. . 


Let W denote the algebraic hull of Vg in As. Since X- Us is an algebrai; 
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subgroup of Ag, we have WC X-Ug. On the other hand, HgW is an 
algebraic subgroup-of As containing HgV¥s— Gs, whence HgW ma Ag. Thus 
X-Us CHW. Since. WCX-Ug and HgN (X-Us)= (1), this gives 
X-Us—-W. Hence the Vg-fixed part of 9 coincides with the X-Ugfixed 
part of S. Since X:Uy is a normal algebraic subgroup of As, the X Us- 
fixed part of S is the algebra of all rational representative functions ‘on 
:As/(X-Us) and therefore separates the ‘points of Hs. Regarding S again 
‘as an algebra of functions on G, we see that this means that the V-fixed 
‘part SY of 8 separates the points of @/V. Since G/V is reductive and since 
-8Y is fully stable, this implies that 97 is the algebra of all analytic repre- 
sentatiyg functions on G/F, i.e. S—R(G)V. Thus we have R(G)’ C8. 
Now let 8 be any proper automorphism of R(G) that leaves the elements 
of S fixed. By Lemma 3.2, S contains the representative functions associated 
with the adjoint representation of G. Thus 8 leaves the representative func- 
tions associated with the adjoint representation of G fixed, whence it follows 
easily that 8 commutes with every left translation, so that 8 lies in the center 
of the group of all proper automorphisms of R(@). 
On the other hand, by condition (1), we have Hom(G,C) C 8. Hence 
8 leaves the elements of Hom(G,(C) fixed. 
_ Let T be any finitely generated fully stable subalgebra of R(@) con- 
taining S. Let Mr be a maximal fully reducible subgroup of Ar, so that Ar 
is the semidirect product Mr: Ur. Accordingly, write $r— mu, with m € Mr 
andu€Uy. Since dr is in the center of Mr, m and u are then the semisimple 
and unipotent components of êm. In particular, this implies that u leaves 
the elements of Hom(G,C) fixed. We know from [1, p. 125] that the kernel 
of the representation of U on C+ Hom(G, C) is precisely N. Hence we 
conclude that u€ Ny. Since dr leaves the elements of 8 fixed, so does u. 
Since S separates the elements of G, it follows that u—1. Hence êr is 
semisimple, and we have shown that every proper automorphism leaving the- 
elements of § fixed is a semisimple element of the center of the group of 
all proper automorphisms of R(@). 
Let F denote the group of all semisimple elements of the center of ‘the 
group of all proper automorphisms of R(G). What we have just.proved is 
' that the fixer S* of 8 in the group of the proper automorphisms of R(@) 
is contained in F. Hence R(G)? C R(G)S*. -Since § is fully stable and 
` finitely generated, it follows from the standard results on algebraic linear 
y „groups and proper automorphisms that B(G)*—8. Thus we have 
R(G)F CS. 
Now recall from [1, Ths. 5. 1, 5.2] that, as a group of proper auto- 
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morphisms of R(@), GU has the form M-U, where M is a fully reducible 
group of proper automorphisms, and that R(G)"’(R(G)™)’ is then a normal 
basic subalgebra of R(@). Now, if T is as above, then Ar is evidently the | 
semidirect product of the algebraic hull of the image of M in Ar and Uy. 
Thus the algebraic hull of the image of M in Ar is a maximal fully reducible 
subgroup of Ar. It must therefore contain the image Fr of F in Ar. Hence 
we conclude that R(G)¥ C R(G)?. 

Now we have R(G)™ C 8, whence also (KM) C 8. Since R(G)’ C S, 
we finally conclude that S contains the normal basic subalgebra R(G)"(R(G)*)’, 
so that 8 is indeed a regular subalgebra of R(G). This completes the proof 
of Theorem 4.1. P 

Theorem 4. 1 can be strengthened considerably in the case where the given 
group @ is solvable. In order to see this, let us first examine the general 
situation from a slightly different point of view. Let $ be a finitely generated 
fully stable subalgebra of R(@) that separates the points of G and contains 
Hom(G,C). Let K be a nucleus of G, and write @=H-K, where H is 
a reductive closed analytic subgroup of G. Then Hg is contained in a 
maximal fully reducible subgroup M of the group Ag of all proper auto- 
morphisms of 8. As before, we have Agm M ‘Ug and MN Gs = Hg. 

Now dim (As) —dim(M) + dim(Us), and we know from [1, Cor. 5.1] 
that dim (U) =—=dim(K). Since dim(Ug) = dim(U) and dim(K;) — dim(K), 
we have dim (Ag) S dim (M) + dim(Ks). Since M and Ks are analytic sub- 
groups of As, since M N Ks = (1), and since Ag is connected, it follows that 
Ag is the semidirect product M: Kg. 

Now let us suppose that @ is solvable. Then Ag must also be solvable, 
which implies that M is abelian. Since M is a fully reducible connected 
algebraic linear group, we know from [2, Lemma 2.2] that M is of the form 
(C*)”. The same holds for the connected algebraic subgroup Hg of J. 
Let P be the maximum compact subgroup of Hg, and let L be the maximum 
compact subgroup of M. Then P and L are toroidal groups and PC D. | 
It follows immediately from the character theory that L==P X P,, where 
P, is again a toroidal group. Now M is the universal complexification of L 
and Hg is the universal complexification of P. Hence it is clear that M is 
_ the direct product M, X Hs, where M, is the universal complexification of P,. 

In particular, our result shows that the canonical map G—Ag is a 
regular algebraic hull. By Theorem 4.1, 9 is therefore a regular subalgebra 
of R(@). We may state these facts as follows. 


THEOREM 4.2, Let G be a solvable analytic group. Then every finitely 


ro 
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generated fully stable subalgebra of R(G) that separates the points of G and 
contains Hom(G,C) is a regular subalgebra of R(@), i. e., contains a normal 
basic subalgebra of R(G). Equivalently, every algebraic hull p: G— L such 
that every analytic homomorphism of G into C is the composite of p with a 
rational homomorphism of L into C is a regular algebraic hull. 


We remark that the example given at the end of [1, Section 3] shows 
that Theorem 4.2 does not hold if the solvability assumption is dropped. In 
fact, it is easily seen that the smallest fully stable algebra containing the 
algebra B of that example is not regular. 


5. Nuclear subalgebras and nuclear algebraic hulls. Let K be any 
nucleus of @. It is clear from [1, Th. 4.1] that there is a unique regular 
subalgebra R(G,K) of R(G) such that, if B is any normal basic subalgebra 
of R(G@) whose associated nucleus is K, R(G,K) coincides with the smallest 
fully stable subalgebra of R(@) that contains B. We shall call R(G, XK) the 
nuclear subalgebra of R(G) that is associated with K. We shall denote by 
Q(K) the subgroup of Q that is generated by those elements q of Q whose 
restrictions gx to K occur as components in the semisimple representation 
associated with the adjoint representation of K. 


THEOREM 5.1. Let G be a complex analytic group whose points are 


separated by R(G), and let K be a nucleus of G. Let B be any normal 


basic subalgebra of R(G) whose associated nucleus is K. Then R(G,K) 


= B[Q(K)]}. 


Proof. By Lemma 3.1, R(G,K) —B[Q,], where Q, =R(G,E) NQ. 
What remains to be proved is only that Q,—@(K). By Lemma 3.2, 
R(@,K) contains the representative functions associated with the adjoint 
representation of G. Now let g be an element of Q such that qg occurs as a 
component of the semisimple representation associated with the adjoint 


, representation of K. This representation is a component of the representation 


of K that is induced by the semisimple representation associated with the 
adjoint representation of G. Hence we conclude that gr€ R(G,K)x. We 
have R(G,K)x=Bk[(Q:)x], and the elements of Qr are free over Br. 
Hence it follows that gx € (Q:)x, which implies that g¢Q,. Thus we have 
shown that Q(K) C R(G,K). : 

In order to complete our proof, it will therefore suffice to show that 
B[Q(K)] is fully stable. We know that it is stable under the left transla- 
tions. In order to show that it is stable under the right translations, it 
suffices to show that, for every element g of G, B-g C B[Q(K)]. 
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. Let S be any finite-dimensional left K-stable subspace of B.: By Corollary 
2.1, S is the sum of K-submodules Ss corresponding to equivalence classes ô, 
mod Q(K)x, of analytic homomorphisms qx: K—> C*, where q is an element 
of Q. If Ss (0) there is a non-zero element s in S and an element gr 
in 8 such that z-s—q(x)s for every element z of K. This means that 
gts € R(G)E, so that YIseB. Thuss€BNBg. But BN Bg= (0), unless 
_ q==1. Hence & is necessarily the equivalence class containing 1, i.e., 
8 C Q(K)x, and S = 8s. 

For every element q of Q, let a aaa the projection R(G) > Bq that 
corresponds to the decomposition R(G) = 2 Bg. If p, denotes the right 


translation on R(@) effected by the dct b of G then ¢¢° pg is avidently 
a left G-module endomorphism . of R(@). In particular, a(S: g) is a K- 
homomorphic image of 9. Hence it follows from our above result that every 
non-zero ¢g(S-g) has only a single associated class of homomorphisms 
K->O*, and that this class is contained in Q(K)x. On the other hand, 
oq(8- 9) is evidently of the form Tg, where T is a K-submodule of B. If + 
is the class of homomorphisms K— C* that is associated with T then the 
class of homomorphisms associated with Tg is evidently rqe. Now we know 
that both r and rgr are contained in Q(K)x. Hence we must have 
qx€Q(K)x, whence geQ(K). We have shown that if a(S >q) = (0) 
then geQ(K). This gives S-g C B[Q(K)], whence .B-g C B[Q(K)], 
which completes the proof that B[Q(K) ] is stable under the right translations. 
~ Tt remains to show that B[Q(K)] is stable under the involution f — f. 
Since B[Q(K)] is two-sidedly stable, this will follow as soon as we have 
‘shown that, whenever B[Q(K)] contains the representative functions asso- 
‘ciated with some representation p, it also contains the representative functions 
associated with the representation p* dual to p. Now the representative func- 
tions associated with p* belong to the algebra generated by the representative 
functions associated with p and the reciprocal of the function dop, where d 
is the determinant function associated with p. We have a semidirect product 
‘decomposition G=H-K. Let p be the element of Hom (G, C*) defined by 
p(hk) = d(p(h)), where he H and kE K. Then pe R(G)K, and hence also 
‘p> >E R(G)ECB. Now p*(dop) € Hom(G,C*) and its restriction to H 
‘is the constant 1. Hence p*(dop)€Q. On the other hand, since pieB 
and dop€ B[Q(K)], by our assumption on p, ‘we have p*(dop) € B[Q(K)]. 
Hence p*(dop)€Q(K). Thus the reciprocal of dop belongs to pQ(K) 
C B[Q(K)]. This completes our proof of Theorem 5.1. 
We write A(G, K) for Arca,m and call the canonical map y: G- A(G, K) 
the nuclear algebraic hull associated with the nucleus K. If p: G>T and 
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o: G>M are any algebraic hulls, we shall say that p dominates o if there 
is a rational homomorphism 8: LM such that Bop=o. Then £ is neces- 
sarily surjective, and 8 is unique. As’an immediate consequence of Theorems . 
4.1 and 8.1-we have the following result. 


THEOREM 5.2. An algebraic hull p: G—>L is regular if and only if 
it dominates a nuclear algebraic hull y: G->A(G,K) associated with a 
nuceus K of G. 


We wish to characterize the nuclear algebraic hulls y: G—>A(G,K) by 
a certain universal property. For any algebraic linear group P, let P* denote 
the factor group of P mod its maximum normal unipotent subgroup, and let 
8? be the canonical rational epimorphism P—>P*. Let a denote the adjoint 
representation of K, and let [a(K)] be the algebraic group hull of «(K) 
in the group of all automorphisms of the Lie algebra of K. Now let ¢: GL 
be an analytic homomorphism, where L is an algebraic linear group and $(@) 
is algebraically dense in L. We shall say that & is K-spectal if there is a 
rational homomorphism ¢*: [a(K)]*—> L* such that gto 8! o a == 8h 0 $x. 


THEOREM 5.3. In the notation introduced above, the canonical homo- 
morphism y: G>A(G,K) is K-special. If $: G>L is any K-spectal 
homomorphism there exists one and only one rational homomorphism 4: 
A(G, K)>L such that = $7 oy. 


In order to prove this result, we require § some EN of semisimple 
representative functions. Let $ be a complex analytic representation of G, 
and let L be the algebraic group hull of ¢(@) in the requisite full linear 
group. Let 8(¢) denote the smallest fully stable subalgebra of R(G) that 
contains the, representative functions associated with ¢. Let P(L) denote 
the algebra of all rational representative functions on L. It is seen imme- 
diately from the definitions that the map f->fod¢ is an algebra isomorphism 


- of P(L) onto S(¢). 


Let U denote the maximum unipotent normal, ae of L, i.e., the 
kernel of 32. Then the U-fixed subalgebra P(L)V of P(L) is isomorphic, 
by the cohomomorphism of 82, with P(Z*). Since L* is a fully reducible 
algebraic linear group, it follows that P(L)T consists entirely of semisimple. 
representative functions. Hence P(L)Yo% is contained in the algebra 3(¢)s 
of-the semisimple elements of S(¢). Conversely, if f is an element of P(L) 
such that fog is a semisimple representative function on G it follows from 
the fact that #(G@) ‘is algebraically dense in L that f is a semisimple repre- 
sentative function on Z. This implies that the representation of U on the 
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space of the left translates of f is semisimple and hence that air 
Hence we have S(¢),==P(L)"!0¢. 

I£ V is the representation space for œ then the members of a ER 
series for V as a @-module are stable also under L. Let V’ be the direct sum 
of the factor modules of this composition series. Then, as a G-module, V’ 
realizes the semisimple representation ¢’ associated with ¢. On the other 
hand, the representation of L on V’ has precisely U for its kernel.~ The 
image of.Z under this representation may be identified with L*, and if we 
apply the above consideration to ¢’ and L* we find that 8(¢’) is isomorphic 
with P(L*). 

We may summarize these facts by writing S(p), = P(L*) 0840 6 = 8(¢’). 
The following lemma will be convenient for the proof of Theorem 5.3. 

Lemma 5.1. A complex analytic representation ¢ of G ts K-special if 
and only tf the restrictions to K of the semisimple representative functions 
associated with & belong to S(a), where a denotes the adjoint representation 
of K. 

Proof. Suppose first that p: GL is K-special. Let f be a semisimple 
representative function associated with.¢. From the above, we know that 
f=go8t op, with g in P(L*). Hence fx—goSlogr. By assumption, we 
have öl o pr — +o 8il oa, where $* is a rational homomorphism [«(K)]* 
—> L*. Thus we have fr— (g o ġ* osit) og, Since d* os“! js a rational _ 
homomorphism, we have go pt o 8E E P([a(K)]), so that the last result 
gives f€ S(a). | 

Now suppose that the restriction to K of every semisimple representative 
function associated with belongs to S(a). From our above discussion, we 
know that 8(8°0$) —=8(6),. Hence our assumption gives S($” o $)x C S(a),. 
The result just used for & holds also for a, so that 9 (a), = 8 (80 o q), 
Thus we have S(8/o¢x) C §(8@®Mlow). Let ze [a(K)]*. Then we. may 
regard q as a specialization of P([a(K)]*). The map f— fost oq is an 
isomorphism of P([a(K)]*) onto S($l«@log) by means of which z is 
transported to a specialization v’ of the last algebra. By restriction, 2’ induces 
a specialization 2” of 9 (8l osx). Via êlo ¢x, this yields a specialization g” 
of P(L*) and thus an element $*(z) of L*. It is clear from this construction 
that ¢* is an everywhere defined rational map of [«(K)]* into L*. 

On the other hand, since § (8% o0 dr) C §(8!@@log), the kernel of 840 ox 
contains the kernel of eog, so that 8¢o¢x induces a homomorphism 
y: L (a(K))—>L*. It is clear from the definitions that the restriction 
to 8l@()l(a(K)) of the above map ¢* coincides with this homomorphism y. 
Since 8!*l(a(K)) is algebraically dense in [«(K)]*, it follows that ¢* is 
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actually a homomorphism and that ¢*o8l®loq— Sods. Thus ¢ is K- 
special, and Lemma 6.1 is proved. 

Now we are in a position to prove Theorem 5.3. We have S(y) = R(G, K), 
and B(@,K),—= (B[Q(K)])s—=B.[Q(K)]=R(@)*[Q(K)]. Hence the 
restrictions to K'of the semisimple representative functions associated with y 
belong to C[Q(K)x]. Since this last algebra is contained in S(«), it follows 
from Lemma 5.1 that y is K-special. 

Now let ¢: @>L be any K-special homomorphism. Let F denote the 
space of the representative functions associated with ¢. We wish to show 
that FC R(G,K). Clearly, F is contained in a sum Siga + * -+9nQn, 
where the Ss are finite-dimensional two-sidedly translation stable subspaces 
of R(G,K) and qı’ ` +, qa are elements of Q no two of which belong to the 
same coset of Q(K) in Q. Our sum is necessarily a direct sum. Let p, be 
the projection of F to the summand Sig, Since p, commutes with the 
translations, we have p(F) CF. Hence F is actually equal to a sum 
Sig. +: + -+ Sagna Passing to the semisimple parts, we obtain 


Pam (Si) +: + (Sn) sga 


Since & is K-special, we have, from Lemma 5.1, (F,)x C S(a),. But S(a), 
— S(x) —C[Q(K)x]. Hence we conclude that ((S:).)x(qi)x C ClQ(K)x]. 
Since S, is two-sidedly translation stable, it coincides with the space of 
all representative functions associated with the representation of G by lett 
translations on Sı Hence, if 8,54 (0), then also (S:)s 34 (0). Since (8), 
is translation stable, it follows that ((8),)x> (0). On the other hand, 
since S; C R(G,K), we have ((S;)s)x C C[Q(K)x]. Hence the inclusion 
we obtained above implies that (q)r€Q(K)x, so that qE Q(K). This 
means that F C R(G,K). 

Hence we have S(¢) C R(G,K), and now we can produce the required 
rational homomorphism ¢7 by the process used in the proof-of Lemma 5.1: 
let se A(G,K), and let 2’ be the specialization of S(¢) obtained as the 
restriction of the specialization f— f(z) of R(G,K). Via ¢, this yields a 
specialization g” of P(L) and thus an element of L. Evidently, 6% is an 
everywhere defined rational map of A(G,K) into L, and dYoy==d. Since 
y(@) is algebraically dense in A(G,K), it follows that ¢7 is actually a 
homomorphism and that it is uniquely determined as a rational homomorphism 


by the requirement d¥oy—¢. The proof of Theorem 6.3 is therefore 
complete. i 


THEOREM 5.4. Let K be à nucleus of the complex analytic group G. 
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Let T denotes the maximum nilpotent normal analytic subgroup of K, and - 
let U denote the terminal member of the descending central series of K. 
Finally, let U’ denote the commutator subgroup of U. Then, tf d is the rank 
of Q(X), one has dim(K/T) SdSdim(U/U’). 


‘Proof. Since the adjoint representation of K induces a unipotent repre- 
sentation of K on the Lie algebra of K/U, the non-trivial part of the 
associated semisimple representation is already obtained from the adjoint 
representation of K on the Lie algebra U of U. Next we observe that if 9 
is a subspace of U such that S-+ [U, U] =U then, since U is nilpotent, we 
obtain U= 81+: +5, where 8; and Su [8,8,]. Hence we see 
that the semisimple K-module associated with the adjoint representätion of 
K on U is a homomorphic image of the direct sum of the i-th tensor powers 
(t—=1,:--,%) of the semisimple K-module associated with the adjoint 
representation of K on U/[U,U]. Hence Q(K)x is already generated by the 
components of the semisimple representation associated with the adjoint 
representation of K on U/[U,U], so that we must have dSdim(U/[U,U]) . 
= dim(U/U’). 

On the other hand, we may view the semisimple representation of K that 
is associated with the adjoint representation of K as a semisimple represen- 
tation o of the vector group K/T. Since T is the maximum nilpotent normal 
analytic subgroup of K, the kernel of o must be discrete. Hence o(K/T) is 
a group of the same dimension as K/T. Since Q(K)x is the group generated 
by the 1-dimensional components of ø, it is clear that o may be written as a 
composite «o£, where 8 is the analytic monomorphism of K/T into (C*)4 
that is obtained from a free basis of Q (K) and « is an analytic homomorphism 
of (C*)4 into the requisite full linear group. Hence the dimension of o(K/T) 
cannot exceed d, so that dim(K/T)<=d. This completes the en of 
Theorem 5.4. 

Note that in the case where T=K, i.e., when K is nilpotent, we have 
necessarily d==0. Hence Theorem 3.1 gives y(@) —A(G,K), in this case, 
and the above results contain our former result [1, Th. 8.3] that a nil- 
potent nucleus of G determines an algebraic structure of @. 

The following simple example illustrates the variability of d within the 
limits given in Theorem 5.4. Let @ be the group of all 4-tuples (2, a, b,c), 
where z ranges over. the non-zero complex numbers and a, b, c range over all 
complex numbers, and where the multiplication is 


(2, a, b, C) (21,0, 01, C1) = (ta, a+ oi, b exp (di) + Os, cay +a). 
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Here, the radical N of the commutator subgroup of @ consists of all 
elements of the form (1,0,6,c), so that dim(N) = 2. Corresponding to an 
arbitrary complex number t, we define a nucleus K; of @ as the set of all 
elements of the form (exp(ta),a,b,c). For each ¢, the maximum nilpotent 
normal analytic subgroup T; of K, coincide with N, so that dim(K;/T;) =1. 
In the notation of Theorem 5.4 (with the subscript t added), U, consists of 
the elements (1,0, b,c) if £540 (while U, consists of the elements (1,0, b, 0)), 
and U = (1). Thus, for t0, dim(U;/U?) =2. Now if ¢ is a rational 
~ number the rank d; of Q(K;) is equal to 1; if ¢ is not rational then the 
rank d: is equal to 2. 

Moreover, if u and v are non-zero integers and v>1 then R(@, Ky) 
contains R(G, Ku) properly, showing that, contrary to what one might 
expect in view of Theorem 5.2, the nuclear algebraic hulls can be ae far 
from minimal, in the sense of domination. 


Appendix. We take this opportunity to correct à confusion in a proof 
contained: in [1]. In [1],.p. 125, lines-4 and 3 from the bottom, replace 
linearly, independent with non-zero. . On line 2: from ‘the: bottom, insert 
distinct before elements. On p. 126, replace lines 3, 4, 5, 6 with the following. 

Since G C UM and 054f/ € RM, there is an element u in U such that 


uf) (1) 40. Put g= Full) (1). Then m(g)(1)==0 for every 


element m of M. But this gives g —0, contradicting the linear independence 
of (at, *y Qn). . 
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' Errata to A: H. 1. Stone, «Heneditarily compact spaces,” American Journal ` 


2 of Mathematics, vol. 82 (1960), pp: '900- 916. 


On p. 901, property - -(Bs) should sid: “Every countable open covering 


{i N; H and. ae should read: “Every countably infinite. locally finite open 


- öteri. .”. The italic words were sb lia ones 
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